Jul 09 23:27:47.699461 ip-10-0-132-128 systemd[1]: Starting Kubernetes Kubelet... Jul 09 23:27:48.142415 ip-10-0-132-128 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 23:27:48.142415 ip-10-0-132-128 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 23:27:48.142415 ip-10-0-132-128 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 23:27:48.142415 ip-10-0-132-128 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 23:27:48.142415 ip-10-0-132-128 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 23:27:48.145249 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.145149 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 23:27:48.149820 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149804 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 23:27:48.149820 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149820 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149824 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149828 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149831 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149834 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149837 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149840 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149842 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149847 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149851 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149854 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149856 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149859 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149862 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149864 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149867 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149869 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149872 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149875 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 23:27:48.149885 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149881 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149884 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149886 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149889 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149892 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149895 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149898 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149900 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149903 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149906 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149908 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149911 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149915 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149917 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149920 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149923 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149926 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149929 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149933 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 23:27:48.150349 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149936 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149938 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149941 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149943 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149946 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149949 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149951 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149953 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149956 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149959 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149961 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149963 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149966 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149968 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149971 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149974 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149976 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149979 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149982 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149984 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 23:27:48.150829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149987 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149990 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149994 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149996 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.149999 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150002 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150004 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150007 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150009 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150012 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150014 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150017 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150019 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150022 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150024 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150027 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150030 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150033 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150035 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150037 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 23:27:48.151321 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150040 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150042 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150045 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150047 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150051 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150055 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150058 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150063 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150066 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150068 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150071 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150074 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150076 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150080 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150082 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150085 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150087 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150090 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150092 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150095 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 23:27:48.151957 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150815 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150823 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150825 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150828 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150831 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150834 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150837 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150840 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150843 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150846 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150849 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150852 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150854 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150857 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150859 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150863 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150865 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150868 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150871 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150874 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 23:27:48.152466 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150877 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150880 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150883 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150886 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150888 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150891 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150896 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150899 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150903 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150906 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150909 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150912 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150914 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150917 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150920 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150922 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150925 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150928 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150931 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 23:27:48.152951 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150935 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150939 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150942 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150946 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150948 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150951 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150954 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150956 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150959 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150962 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150964 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150968 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150971 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150974 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150976 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150979 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150982 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150984 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150987 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150989 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 23:27:48.153417 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150992 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150995 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.150997 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151000 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151002 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151005 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151007 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151010 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151012 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151014 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151018 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151020 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151023 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151025 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151028 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151030 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151033 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151035 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151038 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 23:27:48.153902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151041 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151043 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151046 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151049 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151052 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151055 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151057 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151061 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151064 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151066 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151069 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151071 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151074 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151076 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151079 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151081 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151085 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151088 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151091 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 23:27:48.154386 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151093 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151096 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151466 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151471 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151474 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151477 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151479 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151482 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151485 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151488 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151491 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151494 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151496 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151499 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151502 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151506 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151510 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151514 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151517 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 23:27:48.154842 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151520 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151523 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151525 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151528 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151530 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151533 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151535 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151538 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151540 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151543 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151545 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151548 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151551 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151553 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151556 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151559 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151562 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151566 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151569 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151571 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 23:27:48.155335 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151573 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151576 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151581 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151583 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151587 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151589 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151592 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151595 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151597 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151599 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151602 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151605 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151607 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151610 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151612 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151615 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151618 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151620 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151623 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151625 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 23:27:48.155821 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151628 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151630 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151633 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151635 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151638 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151640 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151643 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151645 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151648 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151650 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151652 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151654 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151657 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151660 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151663 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151666 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151668 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151671 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151674 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 23:27:48.156315 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151677 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151680 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151682 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151685 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151688 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151690 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151693 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151695 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151697 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151700 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151703 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151705 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151709 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151713 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151715 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151718 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151721 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151724 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151726 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 23:27:48.156829 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151728 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151731 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151733 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.151736 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151802 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151823 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151829 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151834 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151841 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151844 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151850 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151857 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151863 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151868 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151873 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151878 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151884 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151887 2578 flags.go:64] FLAG: --cgroup-root="" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151890 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151893 2578 flags.go:64] FLAG: --client-ca-file="" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151896 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151899 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151906 2578 flags.go:64] FLAG: --cluster-domain="" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151909 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 23:27:48.157300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151912 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151916 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151919 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151923 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151926 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151929 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151932 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151936 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151939 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151942 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151945 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151948 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151952 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151955 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151958 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151961 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151966 2578 flags.go:64] FLAG: --enable-server="true" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151969 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151976 2578 flags.go:64] FLAG: --event-burst="100" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151980 2578 flags.go:64] FLAG: --event-qps="50" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151983 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151992 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.151997 2578 flags.go:64] FLAG: --eviction-hard="" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152000 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 23:27:48.157904 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152003 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152006 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152009 2578 flags.go:64] FLAG: --eviction-soft="" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152012 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152015 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152018 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152021 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152024 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152027 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152030 2578 flags.go:64] FLAG: --feature-gates="" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152033 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152036 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152040 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152043 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152046 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152049 2578 flags.go:64] FLAG: --help="false" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152052 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152055 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152058 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152060 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152064 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152067 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152070 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 23:27:48.158510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152073 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152077 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152080 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152083 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152086 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152089 2578 flags.go:64] FLAG: --kube-reserved="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152091 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152101 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152104 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152107 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152110 2578 flags.go:64] FLAG: --lock-file="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152113 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152116 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152119 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152124 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152127 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152130 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152132 2578 flags.go:64] FLAG: --logging-format="text" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152135 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152139 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152142 2578 flags.go:64] FLAG: --manifest-url="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152144 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152148 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152151 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152155 2578 flags.go:64] FLAG: --max-pods="110" Jul 09 23:27:48.159091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152158 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152161 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152164 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152167 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152170 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152173 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152175 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152197 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152201 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152205 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152208 2578 flags.go:64] FLAG: --pod-cidr="" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152211 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152216 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152219 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152222 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152227 2578 flags.go:64] FLAG: --port="10250" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152230 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152233 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-055ad6d2336e60bd8" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152236 2578 flags.go:64] FLAG: --qos-reserved="" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152239 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152242 2578 flags.go:64] FLAG: --register-node="true" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152245 2578 flags.go:64] FLAG: --register-with-taints="" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152248 2578 flags.go:64] FLAG: --registry-burst="10" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152251 2578 flags.go:64] FLAG: --registry-qps="5" Jul 09 23:27:48.159719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152254 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152257 2578 flags.go:64] FLAG: --reserved-memory="" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152260 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152264 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152267 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152270 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152272 2578 flags.go:64] FLAG: --runonce="false" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152275 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152278 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152281 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152284 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152287 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152290 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152294 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152297 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152299 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152304 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152307 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152310 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152313 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152316 2578 flags.go:64] FLAG: --system-cgroups="" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152319 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152324 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152328 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152331 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 23:27:48.160343 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152335 2578 flags.go:64] FLAG: --tls-min-version="" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152338 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152341 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152344 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152347 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152350 2578 flags.go:64] FLAG: --v="2" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152353 2578 flags.go:64] FLAG: --version="false" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152358 2578 flags.go:64] FLAG: --vmodule="" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152361 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.152365 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152497 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152502 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152505 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152508 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152512 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152515 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152519 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152522 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152525 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152527 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152530 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152532 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 23:27:48.160944 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152535 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152539 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152541 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152544 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152546 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152549 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152552 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152555 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152562 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152565 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152568 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152571 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152573 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152577 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152580 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152583 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152586 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152589 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 23:27:48.161534 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152592 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152595 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152598 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152601 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152604 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152607 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152610 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152612 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152616 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152618 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152621 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152624 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152626 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152629 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152632 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152635 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152637 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152639 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152642 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152645 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 23:27:48.161994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152648 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152652 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152654 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152657 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152660 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152663 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152666 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152668 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152671 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152674 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152677 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152680 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152682 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152685 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152687 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152690 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152692 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152695 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152697 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 23:27:48.162499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152700 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152703 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152705 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152708 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152710 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152713 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152716 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152719 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152721 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152724 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152726 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152729 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152731 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152734 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152739 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152743 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152746 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152749 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152752 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 23:27:48.162968 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152755 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152757 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152760 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152762 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152765 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152767 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152770 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152773 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152775 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.152778 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.154141 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.161339 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.161353 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.162209 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.162216 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 23:27:48.163452 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162274 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162280 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162283 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162286 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162289 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162292 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162295 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162299 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162301 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162304 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162307 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162309 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162312 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162315 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162318 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162321 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162324 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162327 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162330 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162333 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 23:27:48.163816 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162335 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162338 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162341 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162343 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162345 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162348 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162351 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162353 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162357 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162360 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162363 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162365 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162368 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162370 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162373 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162375 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162378 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162381 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162384 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162386 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 23:27:48.164435 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162390 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162392 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162395 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162397 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162400 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162402 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162405 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162407 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162410 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162413 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162415 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162418 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162421 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162423 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162426 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162428 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162431 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162433 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162436 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 23:27:48.164913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162439 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162443 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162446 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162449 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162453 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162457 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162460 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162463 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162466 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162469 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162472 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162474 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162477 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162479 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162482 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162485 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162487 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162490 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162492 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162495 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 23:27:48.165394 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162498 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162500 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162503 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162506 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162510 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162514 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162518 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162521 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162523 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162526 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162528 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162546 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162549 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162553 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162556 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162559 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162562 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162564 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162569 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 23:27:48.165882 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162572 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.162577 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162703 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162708 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162712 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162715 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162718 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162721 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162724 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162726 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162729 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162732 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162734 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162737 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162739 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 23:27:48.166362 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162743 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162746 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162752 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162755 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162758 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162760 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162763 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162765 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162768 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162771 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162773 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162776 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162779 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162781 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162784 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162786 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162789 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162791 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162794 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 23:27:48.166728 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162796 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162799 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162801 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162804 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162806 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162809 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162811 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162814 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162816 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162820 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162823 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162826 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162829 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162832 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162834 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162837 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162840 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162842 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162845 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162848 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 23:27:48.167194 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162850 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162852 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162855 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162857 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162860 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162862 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162865 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162868 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162871 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162874 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162877 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162879 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162882 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162885 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162888 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162890 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162893 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162895 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162898 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 23:27:48.167673 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162900 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162903 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162905 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162908 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162910 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162913 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162915 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162918 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162920 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162923 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162926 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162929 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162931 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162933 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162936 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162938 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162941 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162944 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162947 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162949 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 23:27:48.168124 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162951 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162954 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162956 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162959 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162961 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162964 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162966 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:48.162969 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.162973 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.163077 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.166659 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.168228 2578 server.go:1019] "Starting client certificate rotation" Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.168329 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 23:27:48.168694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.168369 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 23:27:48.171130 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.171117 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 23:27:48.175600 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.175453 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 23:27:48.188335 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.188311 2578 log.go:25] "Validated CRI v1 runtime API" Jul 09 23:27:48.190744 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.190728 2578 log.go:25] "Validated CRI v1 image API" Jul 09 23:27:48.191650 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.191636 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 23:27:48.195159 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.195126 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cf0da012-80c2-4e60-ac5e-717081d4eae5:/dev/nvme0n1p3 df572e98-0630-4360-88b2-fd2715e3b086:/dev/nvme0n1p4] Jul 09 23:27:48.195249 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.195155 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 23:27:48.200365 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.200245 2578 manager.go:216] Machine: {Timestamp:2026-07-09 23:27:48.198858647 +0000 UTC m=+0.370870506 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099076 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec204a5dc938790f82fec7d6235d3464 SystemUUID:ec204a5d-c938-790f-82fe-c7d6235d3464 BootID:9e4a6b48-f93c-41f3-93a1-65cd73e82a97 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:32:1e:22:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:32:1e:22:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:c1:80:ca:8e:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 23:27:48.200365 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.200354 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 23:27:48.200520 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.200443 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 23:27:48.201696 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.201679 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 23:27:48.203884 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.203856 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 23:27:48.204056 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.203892 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 23:27:48.204820 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.204807 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 23:27:48.204874 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.204827 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 23:27:48.204874 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.204838 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 23:27:48.204874 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.204859 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 23:27:48.206714 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.206701 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 23:27:48.210120 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210106 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 09 23:27:48.210268 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210257 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 23:27:48.210336 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210297 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 09 23:27:48.210336 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210312 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 23:27:48.210336 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210331 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 23:27:48.210456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210344 2578 kubelet.go:398] "Adding apiserver pod source" Jul 09 23:27:48.210456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210358 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 23:27:48.210752 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210738 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 23:27:48.210819 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.210761 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 23:27:48.213386 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.213365 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 23:27:48.215856 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.215839 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 23:27:48.215902 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.215873 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 23:27:48.216100 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216088 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 23:27:48.216136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216105 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 23:27:48.216136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216111 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 23:27:48.216136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216116 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 23:27:48.216136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216124 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 23:27:48.216136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216129 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 23:27:48.216634 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216624 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 23:27:48.216634 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216634 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 23:27:48.216692 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216645 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 23:27:48.216692 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216653 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 23:27:48.216692 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216678 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 23:27:48.216692 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.216691 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 23:27:48.217612 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.217601 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 23:27:48.217645 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.217613 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 23:27:48.221038 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.221020 2578 server.go:1268] "Started kubelet" Jul 09 23:27:48.221149 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.221116 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 23:27:48.221280 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.221256 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 23:27:48.221348 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.221300 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 23:27:48.221890 ip-10-0-132-128 systemd[1]: Started Kubernetes Kubelet. Jul 09 23:27:48.226990 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.226954 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 23:27:48.227668 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.227645 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 23:27:48.227856 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.227836 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 23:27:48.228090 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.228066 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 23:27:48.228827 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.228810 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 09 23:27:48.229426 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.229402 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 23:27:48.233471 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.232418 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-128.ec2.internal.18c0c2d3ff9ba2c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-128.ec2.internal,UID:ip-10-0-132-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-128.ec2.internal,},FirstTimestamp:2026-07-09 23:27:48.220994245 +0000 UTC m=+0.393006104,LastTimestamp:2026-07-09 23:27:48.220994245 +0000 UTC m=+0.393006104,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-128.ec2.internal,}" Jul 09 23:27:48.236439 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.236416 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 23:27:48.236439 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.236427 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 23:27:48.236631 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.236611 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.237195 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237163 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 23:27:48.237195 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237166 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 23:27:48.237331 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237208 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 23:27:48.237331 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237311 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 09 23:27:48.237331 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237320 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 09 23:27:48.237544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237527 2578 factory.go:55] Registering systemd factory Jul 09 23:27:48.237595 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237548 2578 factory.go:223] Registration of the systemd container factory successfully Jul 09 23:27:48.237792 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237779 2578 factory.go:153] Registering CRI-O factory Jul 09 23:27:48.237873 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237794 2578 factory.go:223] Registration of the crio container factory successfully Jul 09 23:27:48.237873 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237847 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 23:27:48.237873 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237868 2578 factory.go:103] Registering Raw factory Jul 09 23:27:48.238008 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.237883 2578 manager.go:1196] Started watching for new ooms in manager Jul 09 23:27:48.238380 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.238355 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 23:27:48.238442 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.238378 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 23:27:48.238493 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.238461 2578 manager.go:349] Starting recovery of all containers Jul 09 23:27:48.246927 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.246903 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7gzn7" Jul 09 23:27:48.249352 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.249231 2578 manager.go:354] Recovery completed Jul 09 23:27:48.251937 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.251920 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7gzn7" Jul 09 23:27:48.253446 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.253434 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.255193 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.255163 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.255294 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.255205 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.255294 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.255217 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.256127 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256112 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 23:27:48.256127 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256126 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.256275 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256125 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 23:27:48.256275 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256222 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 09 23:27:48.256829 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256813 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.256903 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256845 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.256903 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.256860 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.257326 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.257313 2578 policy_none.go:49] "None policy: Start" Jul 09 23:27:48.257389 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.257329 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 23:27:48.257389 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.257340 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 23:27:48.258226 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.258215 2578 policy_none.go:47] "Start" Jul 09 23:27:48.288782 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.288765 2578 manager.go:337] "Starting Device Plugin manager" Jul 09 23:27:48.288905 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.288811 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 23:27:48.288905 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.288824 2578 server.go:87] "Starting device plugin registration server" Jul 09 23:27:48.289073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.289060 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 23:27:48.289130 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.289074 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 23:27:48.289409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.289392 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 23:27:48.289687 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.289497 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 23:27:48.289687 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.289558 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 23:27:48.290031 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.289960 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 23:27:48.290031 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.290014 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.339010 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.338959 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 23:27:48.341164 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.340254 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 23:27:48.341164 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.340306 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 23:27:48.341164 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.340332 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 23:27:48.341164 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.340372 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 23:27:48.342610 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.342591 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 23:27:48.389782 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.389740 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.390783 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.390765 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.390859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.390799 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.390859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.390813 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.390859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.390836 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.402916 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.402862 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.402916 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.402891 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-128.ec2.internal\": node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.426274 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.426248 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.440577 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.440548 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal"] Jul 09 23:27:48.440639 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.440618 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.442345 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.442327 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.442345 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.442353 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.442485 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.442368 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.444598 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.444584 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.444696 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.444680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.444751 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.444711 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.445385 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.445373 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.445385 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.445385 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.445538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.445397 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.445538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.445403 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.445538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.445408 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.445538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.445413 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.447521 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.447507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.447578 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.447533 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 23:27:48.448154 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.448141 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientMemory" Jul 09 23:27:48.448213 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.448168 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 23:27:48.448213 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.448200 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeHasSufficientPID" Jul 09 23:27:48.473876 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.473844 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-128.ec2.internal\" not found" node="ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.478341 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.478327 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-128.ec2.internal\" not found" node="ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.527148 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.527121 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.539436 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.539412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a282de8bb107da660700ce7cc100840d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"a282de8bb107da660700ce7cc100840d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.539514 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.539439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a282de8bb107da660700ce7cc100840d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"a282de8bb107da660700ce7cc100840d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.539514 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.539458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fad131b74fcb56c348327d4dd10f9830-config\") pod \"kube-apiserver-proxy-ip-10-0-132-128.ec2.internal\" (UID: \"fad131b74fcb56c348327d4dd10f9830\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.627603 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.627562 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.639909 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.639880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a282de8bb107da660700ce7cc100840d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"a282de8bb107da660700ce7cc100840d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.639969 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.639913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a282de8bb107da660700ce7cc100840d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"a282de8bb107da660700ce7cc100840d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.639969 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.639930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fad131b74fcb56c348327d4dd10f9830-config\") pod \"kube-apiserver-proxy-ip-10-0-132-128.ec2.internal\" (UID: \"fad131b74fcb56c348327d4dd10f9830\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.640032 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.639986 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a282de8bb107da660700ce7cc100840d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"a282de8bb107da660700ce7cc100840d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.640065 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.640052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fad131b74fcb56c348327d4dd10f9830-config\") pod \"kube-apiserver-proxy-ip-10-0-132-128.ec2.internal\" (UID: \"fad131b74fcb56c348327d4dd10f9830\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.640105 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.640091 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a282de8bb107da660700ce7cc100840d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal\" (UID: \"a282de8bb107da660700ce7cc100840d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.728413 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.728339 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.775823 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.775782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.780806 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:48.780655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" Jul 09 23:27:48.829160 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.829131 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:48.929650 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:48.929616 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.030242 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:49.030160 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.131294 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:49.131247 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.167710 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.167677 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 23:27:49.168167 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.167818 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 23:27:49.232012 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:49.231984 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.255542 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.255489 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 23:22:49 +0000 UTC" deadline="2028-01-26 08:09:09.311166091 +0000 UTC" Jul 09 23:27:49.255542 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.255539 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13568h41m20.05563123s" Jul 09 23:27:49.332566 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:49.332530 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.335022 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:49.334994 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda282de8bb107da660700ce7cc100840d.slice/crio-b393d57090dba807db2195480187c2515fc9d5f63d7966f15caa03f45ae2928c WatchSource:0}: Error finding container b393d57090dba807db2195480187c2515fc9d5f63d7966f15caa03f45ae2928c: Status 404 returned error can't find the container with id b393d57090dba807db2195480187c2515fc9d5f63d7966f15caa03f45ae2928c Jul 09 23:27:49.335547 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:49.335521 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad131b74fcb56c348327d4dd10f9830.slice/crio-179f40cc19f138fa0680a6472df1187854e10ed03c20c45fd30c81a08ceafae9 WatchSource:0}: Error finding container 179f40cc19f138fa0680a6472df1187854e10ed03c20c45fd30c81a08ceafae9: Status 404 returned error can't find the container with id 179f40cc19f138fa0680a6472df1187854e10ed03c20c45fd30c81a08ceafae9 Jul 09 23:27:49.341702 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.341685 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 23:27:49.343307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.343270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" event={"ID":"a282de8bb107da660700ce7cc100840d","Type":"ContainerStarted","Data":"b393d57090dba807db2195480187c2515fc9d5f63d7966f15caa03f45ae2928c"} Jul 09 23:27:49.344228 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.344209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" event={"ID":"fad131b74fcb56c348327d4dd10f9830","Type":"ContainerStarted","Data":"179f40cc19f138fa0680a6472df1187854e10ed03c20c45fd30c81a08ceafae9"} Jul 09 23:27:49.433607 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:49.433570 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.534092 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:49.534051 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-128.ec2.internal\" not found" Jul 09 23:27:49.552777 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.552755 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 23:27:49.637723 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.637653 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" Jul 09 23:27:49.645055 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.645035 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 23:27:49.646886 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.646872 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" Jul 09 23:27:49.663208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.663172 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 23:27:49.718051 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.718023 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 23:27:49.775117 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:49.775086 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 23:27:50.112916 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.112838 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 23:27:50.211507 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.211258 2578 apiserver.go:52] "Watching apiserver" Jul 09 23:27:50.220686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.220653 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 23:27:50.221316 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.221288 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-k54wj","openshift-ovn-kubernetes/ovnkube-node-4cqlq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4","openshift-cluster-node-tuning-operator/tuned-ds7kg","openshift-dns/node-resolver-dlrbx","openshift-image-registry/node-ca-cslvf","openshift-multus/multus-5xkjt","openshift-multus/multus-additional-cni-plugins-99gjz","kube-system/global-pull-secret-syncer-slgdv","kube-system/konnectivity-agent-fz84m","kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal","openshift-multus/network-metrics-daemon-kr4rb","openshift-network-diagnostics/network-check-target-5lxnw"] Jul 09 23:27:50.223983 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.223963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.226519 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.226496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:50.226617 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.226575 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:27:50.227104 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.227085 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h95m7\"" Jul 09 23:27:50.227249 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.227229 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.227591 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.227572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 23:27:50.227787 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.227772 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 23:27:50.227964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.227947 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.228824 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.228808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.230742 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.230691 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.231044 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.231023 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p6nbh\"" Jul 09 23:27:50.231248 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.231224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 23:27:50.231335 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.231305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.231949 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.231932 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.233077 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.233056 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.233441 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.233422 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.233809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.233789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.233927 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.233903 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jd2pn\"" Jul 09 23:27:50.235041 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.235023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.235686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.235475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bc2nc\"" Jul 09 23:27:50.235686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.235661 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.236406 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.236386 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.237059 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.237038 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 23:27:50.237697 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.237677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.237796 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.237744 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:27:50.238654 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.238633 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.238983 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.238966 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 23:27:50.239194 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.239156 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4mm5x\"" Jul 09 23:27:50.239497 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.239471 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.240351 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.240331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:50.242629 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.242610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.244243 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.244118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.245237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.244442 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 23:27:50.245237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.244703 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fx5jx\"" Jul 09 23:27:50.245237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.245012 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.245766 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.245465 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:50.245766 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.245686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 23:27:50.245888 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.245810 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 23:27:50.246402 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.246379 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 23:27:50.246510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.246493 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 23:27:50.246870 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.246675 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 23:27:50.246870 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.246740 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fc9c\"" Jul 09 23:27:50.247040 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.247020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 23:27:50.248074 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.247879 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 23:27:50.248074 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.248040 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.248736 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.248715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 23:27:50.249116 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.249096 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gftfg\"" Jul 09 23:27:50.249817 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.249797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-netns\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.249906 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.249845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-cni-multus\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.249959 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.249914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-hostroot\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250112 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:50.250218 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkb6d\" (UniqueName: \"kubernetes.io/projected/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-kube-api-access-gkb6d\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.250286 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-systemd\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.250334 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzdz\" (UniqueName: \"kubernetes.io/projected/e7ea5e82-f961-4203-bc90-fcce30bb129d-kube-api-access-wnzdz\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.250384 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-system-cni-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250457 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:50.250513 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-os-release\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250567 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6790f8b4-edf2-43dd-9629-9af878cd7e64-cni-binary-copy\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250613 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-host\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.250661 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-serviceca\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.250661 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-dbus\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.250748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-socket-dir-parent\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-kubelet\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250833 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-daemon-config\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.250833 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysconfig\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.250924 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.250827 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:27:50.250924 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-lib-modules\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.251020 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.250951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zx7s\" (UniqueName: \"kubernetes.io/projected/6790f8b4-edf2-43dd-9629-9af878cd7e64-kube-api-access-8zx7s\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.251069 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sznd\" (UniqueName: \"kubernetes.io/projected/9327c044-5bf6-4c2b-9809-ac5d277649a6-kube-api-access-5sznd\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:50.251165 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-device-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.251451 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251431 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 23:27:50.251515 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-kubernetes\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.251612 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-host\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.251670 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.251723 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-socket-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.251723 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6pxbm\"" Jul 09 23:27:50.251815 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-cni-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.251815 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.251815 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.251790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-modprobe-d\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.252032 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-sys\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.252089 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-cnibin\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.252141 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-k8s-cni-cncf-io\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.252209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-cni-bin\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.252272 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 23:27:50.252476 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-conf-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.252537 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-multus-certs\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.252604 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-etc-kubernetes\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.252650 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-registration-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.252650 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysctl-d\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.252747 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.252747 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/278e24fb-2d93-4155-a625-061bf06dbad6-hosts-file\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.252841 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278e24fb-2d93-4155-a625-061bf06dbad6-tmp-dir\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.252841 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysctl-conf\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.252935 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-run\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.252935 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-var-lib-kubelet\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.253038 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ea5e82-f961-4203-bc90-fcce30bb129d-tmp\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.253038 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.252978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-kubelet-config\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.253038 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.253013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-sys-fs\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.253171 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.253077 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 23:27:50.253171 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.253150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhpsl\" (UniqueName: \"kubernetes.io/projected/278e24fb-2d93-4155-a625-061bf06dbad6-kube-api-access-qhpsl\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.253280 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.253206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-tuned\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.253329 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.253298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gccm\" (UniqueName: \"kubernetes.io/projected/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-kube-api-access-5gccm\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.277834 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.277784 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-drxlp" Jul 09 23:27:50.283308 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.283290 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-drxlp" Jul 09 23:27:50.338699 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.338665 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 23:27:50.354475 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zx7s\" (UniqueName: \"kubernetes.io/projected/6790f8b4-edf2-43dd-9629-9af878cd7e64-kube-api-access-8zx7s\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-device-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-iptables-alerter-script\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-cni-bin\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-socket-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.354644 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354634 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-device-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-modprobe-d\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-sys\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354770 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-socket-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c14e169-1d63-4633-aae0-f7f0ce812284-ovn-node-metrics-cert\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-sys\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-k8s-cni-cncf-io\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-cni-bin\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-etc-kubernetes\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354842 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-modprobe-d\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.354929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-k8s-cni-cncf-io\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-run\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354935 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-run\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-etc-kubernetes\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-cni-bin\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.354989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-kubelet-config\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355005 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-kubelet-config\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/278e24fb-2d93-4155-a625-061bf06dbad6-hosts-file\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysctl-conf\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ea5e82-f961-4203-bc90-fcce30bb129d-tmp\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355146 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/278e24fb-2d93-4155-a625-061bf06dbad6-hosts-file\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-systemd-units\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-ovnkube-config\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhpsl\" (UniqueName: \"kubernetes.io/projected/278e24fb-2d93-4155-a625-061bf06dbad6-kube-api-access-qhpsl\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.355539 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-tuned\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysctl-conf\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-kubelet\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-cni-multus\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-hostroot\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-cni-multus\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkb6d\" (UniqueName: \"kubernetes.io/projected/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-kube-api-access-gkb6d\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355536 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-hostroot\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355530 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.355548 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzdz\" (UniqueName: \"kubernetes.io/projected/e7ea5e82-f961-4203-bc90-fcce30bb129d-kube-api-access-wnzdz\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.355629 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:50.855607765 +0000 UTC m=+3.027619614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-etc-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cnibin\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-system-cni-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.356357 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6790f8b4-edf2-43dd-9629-9af878cd7e64-cni-binary-copy\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-host\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-system-cni-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.355985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-serviceca\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-dbus\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-host-slash\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a957277-096c-4e67-83b0-c2bff331a7ff-agent-certs\") pod \"konnectivity-agent-fz84m\" (UID: \"4a957277-096c-4e67-83b0-c2bff331a7ff\") " pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-system-cni-dir\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-lib-modules\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-run-netns\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-log-socket\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-host\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfg68\" (UniqueName: \"kubernetes.io/projected/fd89832e-5e36-43c1-ac55-44d6349ccf9b-kube-api-access-kfg68\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-dbus\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sznd\" (UniqueName: \"kubernetes.io/projected/9327c044-5bf6-4c2b-9809-ac5d277649a6-kube-api-access-5sznd\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-lib-modules\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-kubernetes\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.357157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-host\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-cni-netd\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8rh2\" (UniqueName: \"kubernetes.io/projected/4c14e169-1d63-4633-aae0-f7f0ce812284-kube-api-access-j8rh2\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-cni-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-host\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-cnibin\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356576 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6790f8b4-edf2-43dd-9629-9af878cd7e64-cni-binary-copy\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.356628 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-cni-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356656 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-kubernetes\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-conf-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-serviceca\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-cnibin\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-multus-certs\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:50.356764 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:50.856746669 +0000 UTC m=+3.028758530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:50.357936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-registration-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-multus-certs\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-conf-dir\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysctl-d\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-slash\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.356960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-ovn\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357009 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysctl-d\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-ovnkube-script-lib\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-registration-dir\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278e24fb-2d93-4155-a625-061bf06dbad6-tmp-dir\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-var-lib-kubelet\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9dmq\" (UniqueName: \"kubernetes.io/projected/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-kube-api-access-w9dmq\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-sys-fs\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357284 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-var-lib-kubelet\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gccm\" (UniqueName: \"kubernetes.io/projected/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-kube-api-access-5gccm\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-sys-fs\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.358779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278e24fb-2d93-4155-a625-061bf06dbad6-tmp-dir\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-netns\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-systemd\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-var-lib-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-run-netns\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-os-release\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-systemd\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357635 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-systemd\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-node-log\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-env-overrides\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-socket-dir-parent\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-os-release\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-kubelet\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357794 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-socket-dir-parent\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-daemon-config\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysconfig\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.359499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6790f8b4-edf2-43dd-9629-9af878cd7e64-host-var-lib-kubelet\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.360146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a957277-096c-4e67-83b0-c2bff331a7ff-konnectivity-ca\") pod \"konnectivity-agent-fz84m\" (UID: \"4a957277-096c-4e67-83b0-c2bff331a7ff\") " pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:50.360146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-os-release\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:50.360146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.357929 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-sysconfig\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.360146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.358323 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6790f8b4-edf2-43dd-9629-9af878cd7e64-multus-daemon-config\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.360146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.359142 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7ea5e82-f961-4203-bc90-fcce30bb129d-etc-tuned\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.360146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.359204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ea5e82-f961-4203-bc90-fcce30bb129d-tmp\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.363242 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.363107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zx7s\" (UniqueName: \"kubernetes.io/projected/6790f8b4-edf2-43dd-9629-9af878cd7e64-kube-api-access-8zx7s\") pod \"multus-5xkjt\" (UID: \"6790f8b4-edf2-43dd-9629-9af878cd7e64\") " pod="openshift-multus/multus-5xkjt" Jul 09 23:27:50.363545 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.363519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhpsl\" (UniqueName: \"kubernetes.io/projected/278e24fb-2d93-4155-a625-061bf06dbad6-kube-api-access-qhpsl\") pod \"node-resolver-dlrbx\" (UID: \"278e24fb-2d93-4155-a625-061bf06dbad6\") " pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:50.364617 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.364545 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkb6d\" (UniqueName: \"kubernetes.io/projected/d30fcbbd-c43e-4401-86cd-3174f0cb0cd9-kube-api-access-gkb6d\") pod \"aws-ebs-csi-driver-node-hqzd4\" (UID: \"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:50.366167 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.366143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sznd\" (UniqueName: \"kubernetes.io/projected/9327c044-5bf6-4c2b-9809-ac5d277649a6-kube-api-access-5sznd\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:50.366340 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.366313 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzdz\" (UniqueName: \"kubernetes.io/projected/e7ea5e82-f961-4203-bc90-fcce30bb129d-kube-api-access-wnzdz\") pod \"tuned-ds7kg\" (UID: \"e7ea5e82-f961-4203-bc90-fcce30bb129d\") " pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:50.367735 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:50.367713 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gccm\" (UniqueName: \"kubernetes.io/projected/a5f0b288-4c39-4817-bcb3-fc65a89a3d74-kube-api-access-5gccm\") pod \"node-ca-cslvf\" (UID: \"a5f0b288-4c39-4817-bcb3-fc65a89a3d74\") " pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:51.686948 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.686911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.686948 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.686958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c14e169-1d63-4633-aae0-f7f0ce812284-ovn-node-metrics-cert\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.686986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-systemd-units\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-ovnkube-config\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-kubelet\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687032 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-etc-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cnibin\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687153 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-kubelet\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-host-slash\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-etc-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a957277-096c-4e67-83b0-c2bff331a7ff-agent-certs\") pod \"konnectivity-agent-fz84m\" (UID: \"4a957277-096c-4e67-83b0-c2bff331a7ff\") " pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-system-cni-dir\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687309 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-systemd-units\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687326 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cnibin\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-run-netns\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-host-slash\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-system-cni-dir\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-log-socket\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-log-socket\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfg68\" (UniqueName: \"kubernetes.io/projected/fd89832e-5e36-43c1-ac55-44d6349ccf9b-kube-api-access-kfg68\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687552 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-run-netns\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-cni-netd\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687614 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-cni-netd\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.687620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8rh2\" (UniqueName: \"kubernetes.io/projected/4c14e169-1d63-4633-aae0-f7f0ce812284-kube-api-access-j8rh2\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-slash\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-ovn\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-ovnkube-config\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687758 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-ovn\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-slash\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-ovnkube-script-lib\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9dmq\" (UniqueName: \"kubernetes.io/projected/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-kube-api-access-w9dmq\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-var-lib-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687969 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.687977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-systemd\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-node-log\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688016 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-run-systemd\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.688428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-env-overrides\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-node-log\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a957277-096c-4e67-83b0-c2bff331a7ff-konnectivity-ca\") pod \"konnectivity-agent-fz84m\" (UID: \"4a957277-096c-4e67-83b0-c2bff331a7ff\") " pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-os-release\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-iptables-alerter-script\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688214 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd89832e-5e36-43c1-ac55-44d6349ccf9b-os-release\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-cni-bin\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688350 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-ovnkube-script-lib\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688526 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c14e169-1d63-4633-aae0-f7f0ce812284-env-overrides\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-var-lib-openvswitch\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c14e169-1d63-4633-aae0-f7f0ce812284-host-cni-bin\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-iptables-alerter-script\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.688918 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a957277-096c-4e67-83b0-c2bff331a7ff-konnectivity-ca\") pod \"konnectivity-agent-fz84m\" (UID: \"4a957277-096c-4e67-83b0-c2bff331a7ff\") " pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:51.689236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.689144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd89832e-5e36-43c1-ac55-44d6349ccf9b-cni-binary-copy\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.689985 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.689722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c14e169-1d63-4633-aae0-f7f0ce812284-ovn-node-metrics-cert\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.689985 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.689952 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a957277-096c-4e67-83b0-c2bff331a7ff-agent-certs\") pod \"konnectivity-agent-fz84m\" (UID: \"4a957277-096c-4e67-83b0-c2bff331a7ff\") " pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:51.692195 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:51.692172 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:27:51.692195 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:51.692193 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:27:51.692360 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:51.692206 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:51.692360 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:51.692267 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:52.192247209 +0000 UTC m=+3.136160893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:51.694519 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.694498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfg68\" (UniqueName: \"kubernetes.io/projected/fd89832e-5e36-43c1-ac55-44d6349ccf9b-kube-api-access-kfg68\") pod \"multus-additional-cni-plugins-99gjz\" (UID: \"fd89832e-5e36-43c1-ac55-44d6349ccf9b\") " pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:51.694708 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.694686 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9dmq\" (UniqueName: \"kubernetes.io/projected/3dd883a0-7bd9-45ef-8b70-b2745f0a6752-kube-api-access-w9dmq\") pod \"iptables-alerter-k54wj\" (UID: \"3dd883a0-7bd9-45ef-8b70-b2745f0a6752\") " pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.694850 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.694834 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8rh2\" (UniqueName: \"kubernetes.io/projected/4c14e169-1d63-4633-aae0-f7f0ce812284-kube-api-access-j8rh2\") pod \"ovnkube-node-4cqlq\" (UID: \"4c14e169-1d63-4633-aae0-f7f0ce812284\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.770374 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.770339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5xkjt" Jul 09 23:27:51.776708 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.776683 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" Jul 09 23:27:51.789368 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.789339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" Jul 09 23:27:51.797022 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.797001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlrbx" Jul 09 23:27:51.804588 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.804570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cslvf" Jul 09 23:27:51.813134 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.813116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k54wj" Jul 09 23:27:51.819858 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.819842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:27:51.826437 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.826420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:27:51.831964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:51.831947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99gjz" Jul 09 23:27:52.090796 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:52.090717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:52.090796 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:52.090793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:52.090967 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.090902 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:52.091010 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.090912 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:52.091050 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.091013 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:53.090966648 +0000 UTC m=+4.034880330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:52.091050 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.091040 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:53.091028893 +0000 UTC m=+4.034942567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:52.291542 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:52.291512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:52.291723 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.291704 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:27:52.291777 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.291731 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:27:52.291777 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.291746 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:52.291856 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:52.291807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:53.291788112 +0000 UTC m=+4.235701789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:52.514860 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:52.514745 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 23:22:51 +0000 UTC" deadline="2028-02-07 06:16:18.574422179 +0000 UTC" Jul 09 23:27:52.514860 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:52.514812 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13854h48m26.059620307s" Jul 09 23:27:52.576233 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.576202 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278e24fb_2d93_4155_a625_061bf06dbad6.slice/crio-056795c737510fc65bbbb9c80ca8f08c4c08e37f5a18299b454ef7303aba4827 WatchSource:0}: Error finding container 056795c737510fc65bbbb9c80ca8f08c4c08e37f5a18299b454ef7303aba4827: Status 404 returned error can't find the container with id 056795c737510fc65bbbb9c80ca8f08c4c08e37f5a18299b454ef7303aba4827 Jul 09 23:27:52.577499 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.577475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ea5e82_f961_4203_bc90_fcce30bb129d.slice/crio-7fb78867b36e08628dffaeedfa1d4b71339db03ab5e5a7461820e700d847fc13 WatchSource:0}: Error finding container 7fb78867b36e08628dffaeedfa1d4b71339db03ab5e5a7461820e700d847fc13: Status 404 returned error can't find the container with id 7fb78867b36e08628dffaeedfa1d4b71339db03ab5e5a7461820e700d847fc13 Jul 09 23:27:52.578719 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.578686 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f0b288_4c39_4817_bcb3_fc65a89a3d74.slice/crio-8d71c21dc4575cd3f3265f1929937a81c0caaefad00ab501c8e5db8353ce6faf WatchSource:0}: Error finding container 8d71c21dc4575cd3f3265f1929937a81c0caaefad00ab501c8e5db8353ce6faf: Status 404 returned error can't find the container with id 8d71c21dc4575cd3f3265f1929937a81c0caaefad00ab501c8e5db8353ce6faf Jul 09 23:27:52.581947 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.581920 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30fcbbd_c43e_4401_86cd_3174f0cb0cd9.slice/crio-c61a13d4fb4687381ea8254fed6b94684d774b9258970c88b7fd4ab4bb954087 WatchSource:0}: Error finding container c61a13d4fb4687381ea8254fed6b94684d774b9258970c88b7fd4ab4bb954087: Status 404 returned error can't find the container with id c61a13d4fb4687381ea8254fed6b94684d774b9258970c88b7fd4ab4bb954087 Jul 09 23:27:52.583046 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.583020 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6790f8b4_edf2_43dd_9629_9af878cd7e64.slice/crio-ccb637076ba2bb1cb8bc0234cb59f133d8f52669bc4b98e3412de2d2e6949f18 WatchSource:0}: Error finding container ccb637076ba2bb1cb8bc0234cb59f133d8f52669bc4b98e3412de2d2e6949f18: Status 404 returned error can't find the container with id ccb637076ba2bb1cb8bc0234cb59f133d8f52669bc4b98e3412de2d2e6949f18 Jul 09 23:27:52.583980 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.583962 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a957277_096c_4e67_83b0_c2bff331a7ff.slice/crio-2f6b594afe2f4d6a63fafac79cf42c1db8b0fe52285130f7a6ff97f7542b6b1d WatchSource:0}: Error finding container 2f6b594afe2f4d6a63fafac79cf42c1db8b0fe52285130f7a6ff97f7542b6b1d: Status 404 returned error can't find the container with id 2f6b594afe2f4d6a63fafac79cf42c1db8b0fe52285130f7a6ff97f7542b6b1d Jul 09 23:27:52.585744 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.585718 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c14e169_1d63_4633_aae0_f7f0ce812284.slice/crio-239ede17fecd435d771c22c0efd7d8b15b67fca74d34d737fb9a7b986b3441c2 WatchSource:0}: Error finding container 239ede17fecd435d771c22c0efd7d8b15b67fca74d34d737fb9a7b986b3441c2: Status 404 returned error can't find the container with id 239ede17fecd435d771c22c0efd7d8b15b67fca74d34d737fb9a7b986b3441c2 Jul 09 23:27:52.586585 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:27:52.586429 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd89832e_5e36_43c1_ac55_44d6349ccf9b.slice/crio-bece193cdbd938c6ea86c36a96aeda692080c20a9c31c75a852ea8470560b1b3 WatchSource:0}: Error finding container bece193cdbd938c6ea86c36a96aeda692080c20a9c31c75a852ea8470560b1b3: Status 404 returned error can't find the container with id bece193cdbd938c6ea86c36a96aeda692080c20a9c31c75a852ea8470560b1b3 Jul 09 23:27:53.096214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.096121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:53.096214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.096196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:53.096453 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.096300 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:53.096453 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.096334 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:53.096453 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.096368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:55.096349876 +0000 UTC m=+6.040263553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:53.096453 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.096391 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:55.096381063 +0000 UTC m=+6.040294726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:53.298612 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.298561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:53.298803 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.298759 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:27:53.298803 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.298780 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:27:53.298803 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.298792 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:53.298961 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.298858 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:55.298830005 +0000 UTC m=+6.242743689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:53.515664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.515572 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 23:22:51 +0000 UTC" deadline="2028-02-06 04:28:50.264015563 +0000 UTC" Jul 09 23:27:53.515664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.515617 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13829h0m56.748403008s" Jul 09 23:27:53.571075 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.571039 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:53.571238 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.571186 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:27:53.575472 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.575448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:53.575632 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.575603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:27:53.575707 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.575696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:53.575876 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:53.575854 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:27:53.592511 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.592438 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5xkjt" event={"ID":"6790f8b4-edf2-43dd-9629-9af878cd7e64","Type":"ContainerStarted","Data":"ccb637076ba2bb1cb8bc0234cb59f133d8f52669bc4b98e3412de2d2e6949f18"} Jul 09 23:27:53.599703 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.599645 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" event={"ID":"e7ea5e82-f961-4203-bc90-fcce30bb129d","Type":"ContainerStarted","Data":"7fb78867b36e08628dffaeedfa1d4b71339db03ab5e5a7461820e700d847fc13"} Jul 09 23:27:53.606324 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.606295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlrbx" event={"ID":"278e24fb-2d93-4155-a625-061bf06dbad6","Type":"ContainerStarted","Data":"056795c737510fc65bbbb9c80ca8f08c4c08e37f5a18299b454ef7303aba4827"} Jul 09 23:27:53.631402 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.631365 2578 generic.go:356] "Generic (PLEG): container finished" podID="a282de8bb107da660700ce7cc100840d" containerID="cf5587fed3ebc09b009f4d19ed04ba706528b1f0b51f61a971490a9464710ded" exitCode=0 Jul 09 23:27:53.632090 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.632062 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" event={"ID":"a282de8bb107da660700ce7cc100840d","Type":"ContainerDied","Data":"cf5587fed3ebc09b009f4d19ed04ba706528b1f0b51f61a971490a9464710ded"} Jul 09 23:27:53.646000 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.645558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" event={"ID":"fad131b74fcb56c348327d4dd10f9830","Type":"ContainerStarted","Data":"a3d87d18f53cf70ed34ad53a132f10df8c0e5c04a7527ba8dd27fb36ea4921d6"} Jul 09 23:27:53.650471 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.650444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fz84m" event={"ID":"4a957277-096c-4e67-83b0-c2bff331a7ff","Type":"ContainerStarted","Data":"2f6b594afe2f4d6a63fafac79cf42c1db8b0fe52285130f7a6ff97f7542b6b1d"} Jul 09 23:27:53.672243 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.672211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerStarted","Data":"bece193cdbd938c6ea86c36a96aeda692080c20a9c31c75a852ea8470560b1b3"} Jul 09 23:27:53.677101 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.677068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" event={"ID":"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9","Type":"ContainerStarted","Data":"c61a13d4fb4687381ea8254fed6b94684d774b9258970c88b7fd4ab4bb954087"} Jul 09 23:27:53.701802 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.701709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cslvf" event={"ID":"a5f0b288-4c39-4817-bcb3-fc65a89a3d74","Type":"ContainerStarted","Data":"8d71c21dc4575cd3f3265f1929937a81c0caaefad00ab501c8e5db8353ce6faf"} Jul 09 23:27:53.722620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.722581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k54wj" event={"ID":"3dd883a0-7bd9-45ef-8b70-b2745f0a6752","Type":"ContainerStarted","Data":"1b5873111a75acf6c0dd50fbacef41d4ccc4d47745059d638885a5d37dca6cf0"} Jul 09 23:27:53.729404 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:53.729113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"239ede17fecd435d771c22c0efd7d8b15b67fca74d34d737fb9a7b986b3441c2"} Jul 09 23:27:54.743655 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:54.743555 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" event={"ID":"a282de8bb107da660700ce7cc100840d","Type":"ContainerStarted","Data":"17766f38a20ed112e866df8555360e494a3972c330c017bb8b9d37bcf53b78f0"} Jul 09 23:27:54.758395 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:54.757440 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-128.ec2.internal" podStartSLOduration=4.757418033 podStartE2EDuration="4.757418033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:27:53.664986998 +0000 UTC m=+4.608900685" watchObservedRunningTime="2026-07-09 23:27:54.757418033 +0000 UTC m=+5.701331718" Jul 09 23:27:55.113943 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:55.113100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:55.113943 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:55.113155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:55.113943 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.113301 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:55.113943 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.113366 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:59.113345041 +0000 UTC m=+10.057258719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:55.113943 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.113636 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:55.113943 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.113692 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:59.113673647 +0000 UTC m=+10.057587326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:55.314976 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:55.314937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:55.315166 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.315132 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:27:55.315166 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.315151 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:27:55.315166 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.315164 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:55.315359 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.315221 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:27:59.315204408 +0000 UTC m=+10.259118073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:55.569605 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:55.569529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:55.569755 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.569652 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:27:55.569971 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:55.569950 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:55.570038 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.570022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:27:55.570092 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:55.570075 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:55.570215 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:55.570171 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:27:57.568828 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:57.568686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:57.569308 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:57.568837 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:27:57.569308 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:57.569183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:57.569593 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:57.569567 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:27:57.569641 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:57.569610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:57.569721 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:57.569689 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:27:59.143981 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:59.143940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:59.144426 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:59.143992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:59.144426 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.144139 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:59.144426 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.144173 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:59.144426 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.144227 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:07.144205104 +0000 UTC m=+18.088118765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:27:59.144426 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.144250 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:07.144239507 +0000 UTC m=+18.088153174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:27:59.345803 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:59.345759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:59.345965 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.345944 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:27:59.346007 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.345971 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:27:59.346007 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.345983 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:59.346110 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.346044 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:07.346025688 +0000 UTC m=+18.289939361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:27:59.570529 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:59.569849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:27:59.570529 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.569984 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:27:59.570529 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:59.570397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:27:59.570529 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.570491 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:27:59.570861 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:27:59.570536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:27:59.570861 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:27:59.570647 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:01.569685 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:01.569111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:01.569685 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:01.569243 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:01.569685 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:01.569590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:01.570270 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:01.569720 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:01.570270 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:01.569767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:01.570270 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:01.569844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:03.569098 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.568812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:03.569098 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.568817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:03.569664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.568817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:03.569664 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:03.569169 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:03.569664 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:03.569247 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:03.569664 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:03.569353 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:03.768223 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.768183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fz84m" event={"ID":"4a957277-096c-4e67-83b0-c2bff331a7ff","Type":"ContainerStarted","Data":"5d4238dbb71e6f6fca64e303ecff21c3fbf8cf20e53ead4642ebc5ad6e55a285"} Jul 09 23:28:03.769909 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.769881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerStarted","Data":"006cddde35612a10387f8b0f96697047f7022c75573737c8e9852551a1ec80f8"} Jul 09 23:28:03.771809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.771781 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" event={"ID":"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9","Type":"ContainerStarted","Data":"3ba0339c1a11eb5128e61815ce96009c2de9baad2291572cec0f3af347c22190"} Jul 09 23:28:03.773532 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.773506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cslvf" event={"ID":"a5f0b288-4c39-4817-bcb3-fc65a89a3d74","Type":"ContainerStarted","Data":"383f9d2c27dacd761f177568a7859ed4b28e7ff917ee07da1ec96d68ae01226c"} Jul 09 23:28:03.775118 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.775086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" event={"ID":"e7ea5e82-f961-4203-bc90-fcce30bb129d","Type":"ContainerStarted","Data":"6637addb8b4f5fbd419961fa692104b350c89ab0e6c210b394e5610a30764f07"} Jul 09 23:28:03.776737 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.776714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlrbx" event={"ID":"278e24fb-2d93-4155-a625-061bf06dbad6","Type":"ContainerStarted","Data":"ed14efdd450bb9dd6481c55be765c566a096c104afee37d7717d27dec6c6b4f4"} Jul 09 23:28:03.785567 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.785516 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fz84m" podStartSLOduration=4.391840476 podStartE2EDuration="14.785500149s" totalImagesPullingTime="10.393659673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:03.785224237 +0000 UTC m=+14.729137923" watchObservedRunningTime="2026-07-09 23:28:03.785500149 +0000 UTC m=+14.729413833" Jul 09 23:28:03.785690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.785648 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-128.ec2.internal" podStartSLOduration=13.785641586 podStartE2EDuration="13.785641586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:27:54.758355089 +0000 UTC m=+5.702268772" watchObservedRunningTime="2026-07-09 23:28:03.785641586 +0000 UTC m=+14.729555272" Jul 09 23:28:03.801697 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.801636 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cslvf" podStartSLOduration=4.323272429 podStartE2EDuration="14.801616405s" totalImagesPullingTime="10.478343976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:03.798224002 +0000 UTC m=+14.742137668" watchObservedRunningTime="2026-07-09 23:28:03.801616405 +0000 UTC m=+14.745530089" Jul 09 23:28:03.835390 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.835254 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dlrbx" podStartSLOduration=4.358772728 podStartE2EDuration="14.835234223s" totalImagesPullingTime="10.476461495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:03.834891457 +0000 UTC m=+14.778805144" watchObservedRunningTime="2026-07-09 23:28:03.835234223 +0000 UTC m=+14.779147908" Jul 09 23:28:03.855203 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:03.855147 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ds7kg" podStartSLOduration=4.357601803 podStartE2EDuration="14.855125469s" totalImagesPullingTime="10.497523666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:03.854579978 +0000 UTC m=+14.798493663" watchObservedRunningTime="2026-07-09 23:28:03.855125469 +0000 UTC m=+14.799039163" Jul 09 23:28:04.781307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:04.781230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k54wj" event={"ID":"3dd883a0-7bd9-45ef-8b70-b2745f0a6752","Type":"ContainerStarted","Data":"dcf1dc125f9c2e047f75bd249437e8261571212328711a78b306c935a1bdea56"} Jul 09 23:28:04.791356 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:04.791321 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:28:04.792004 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:04.791969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:28:04.794522 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:04.794478 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k54wj" podStartSLOduration=5.328612596 podStartE2EDuration="15.794466172s" totalImagesPullingTime="10.465853576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:04.794046169 +0000 UTC m=+15.737959853" watchObservedRunningTime="2026-07-09 23:28:04.794466172 +0000 UTC m=+15.738379856" Jul 09 23:28:05.569733 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:05.569699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:05.569901 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:05.569699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:05.569901 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:05.569835 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:05.569901 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:05.569699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:05.570064 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:05.569897 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:05.570064 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:05.569977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:06.786024 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:06.785993 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 23:28:07.209772 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:07.209739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:07.209772 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:07.209780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:07.209975 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.209872 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:28:07.209975 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.209878 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:28:07.209975 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.209922 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:23.209909372 +0000 UTC m=+34.153823032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:28:07.209975 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.209936 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:23.20992929 +0000 UTC m=+34.153842951 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:28:07.411249 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:07.411212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:07.411428 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.411389 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:28:07.411428 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.411415 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:28:07.411428 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.411427 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:28:07.411577 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.411494 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:23.41147611 +0000 UTC m=+34.355389773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:28:07.569697 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:07.569617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:07.569827 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:07.569624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:07.569827 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:07.569759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:07.569827 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.569754 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:07.569964 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.569854 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:07.570000 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:07.569957 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:09.570402 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:09.570157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:09.570909 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:09.570243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:09.570909 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:09.570556 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:09.570909 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:09.570266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:09.570909 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:09.570604 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:09.570909 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:09.570673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:11.322795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.322725 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:28:11.323323 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.322927 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 23:28:11.323625 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.323608 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fz84m" Jul 09 23:28:11.569518 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.569486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:11.569681 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:11.569591 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:11.569681 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.569489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:11.569681 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.569636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:11.569851 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:11.569743 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:11.569919 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:11.569845 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:11.736373 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.735376 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 23:28:11.797732 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.797552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" event={"ID":"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9","Type":"ContainerStarted","Data":"3af2ce4721466a660845bb683d15af78c0f0fbb1a8a9444a04e435211b1499a0"} Jul 09 23:28:11.799092 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.799072 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:28:11.799386 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.799365 2578 generic.go:356] "Generic (PLEG): container finished" podID="4c14e169-1d63-4633-aae0-f7f0ce812284" containerID="fa4f5e4d4f81ee118bbe38b9b27927435d2c5cb7415bc1513ea7c1f09601f8f7" exitCode=1 Jul 09 23:28:11.799508 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.799392 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerDied","Data":"fa4f5e4d4f81ee118bbe38b9b27927435d2c5cb7415bc1513ea7c1f09601f8f7"} Jul 09 23:28:11.799508 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.799461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"54285cb1583996c461e722d4399ed08086e568b12493fabbde5ed17759445ca7"} Jul 09 23:28:11.801134 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.801094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5xkjt" event={"ID":"6790f8b4-edf2-43dd-9629-9af878cd7e64","Type":"ContainerStarted","Data":"ce2536ff04f96c7d3bc3e3f5f4d3337ffdfde7f83cca2757e495a4e6e919e023"} Jul 09 23:28:11.802658 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.802636 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd89832e-5e36-43c1-ac55-44d6349ccf9b" containerID="006cddde35612a10387f8b0f96697047f7022c75573737c8e9852551a1ec80f8" exitCode=0 Jul 09 23:28:11.802750 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.802711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerDied","Data":"006cddde35612a10387f8b0f96697047f7022c75573737c8e9852551a1ec80f8"} Jul 09 23:28:11.816767 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:11.816723 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5xkjt" podStartSLOduration=3.8293763 podStartE2EDuration="22.816708336s" totalImagesPullingTime="18.987332036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:11.816464042 +0000 UTC m=+22.760377725" watchObservedRunningTime="2026-07-09 23:28:11.816708336 +0000 UTC m=+22.760622021" Jul 09 23:28:12.531651 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.531552 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T23:28:11.735434574Z","UUID":"5c87b86e-394a-470e-968c-a70cc4ce6bfa","Handler":null,"Name":"","Endpoint":""} Jul 09 23:28:12.533097 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.533063 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 23:28:12.533213 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.533107 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 23:28:12.808374 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.808346 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:28:12.808794 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.808761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"5a26e4a342128631f7f7e6f92114559228c373a5a9de7db0ea9ac3d446676894"} Jul 09 23:28:12.808908 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.808881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"374a21882c8c1eee9429ca35f08caa9fd2bc11ed3d213388a8541ce98e330fad"} Jul 09 23:28:12.808964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.808942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"d4939805347d102cf145fcb5634de60dd0e4e9e3a26a21ba6a74694c82786aa3"} Jul 09 23:28:12.809008 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:12.808986 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"498689025b3f0662c52f0458754bc1630d3f483a867769fc6e2a7218e3464947"} Jul 09 23:28:13.572499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:13.572468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:13.573041 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:13.572583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:13.573041 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:13.572592 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:13.573041 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:13.572685 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:13.573041 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:13.572590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:13.573041 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:13.572805 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:13.813746 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:13.813709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" event={"ID":"d30fcbbd-c43e-4401-86cd-3174f0cb0cd9","Type":"ContainerStarted","Data":"223c2ff497c71f3e9137f9ee3fc7d719b7bcd09a49cd303fc9e2fd5a6a3dc640"} Jul 09 23:28:13.830133 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:13.830046 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hqzd4" podStartSLOduration=4.785911714 podStartE2EDuration="24.830032949s" totalImagesPullingTime="20.044121235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:13.829718216 +0000 UTC m=+24.773631899" watchObservedRunningTime="2026-07-09 23:28:13.830032949 +0000 UTC m=+24.773946631" Jul 09 23:28:14.818036 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:14.818009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:28:14.818494 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:14.818420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"765b713ae9240cb2ad29c24e089687c875d2ac3483cd5f8fcf7700e1a2b2117d"} Jul 09 23:28:15.569003 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:15.568975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:15.569155 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:15.568975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:15.569864 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:15.569007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:15.569994 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:15.569891 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:15.570600 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:15.570562 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:15.570739 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:15.570721 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:17.572578 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.572399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:17.573120 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.572399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:17.573120 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:17.572641 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:17.573120 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.572415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:17.573120 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:17.572793 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:17.573120 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:17.572882 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:17.826994 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.826903 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd89832e-5e36-43c1-ac55-44d6349ccf9b" containerID="78b51a4039e0a5706455d5d336c7935faba03b48cdc4e9bd7f178c44f04be817" exitCode=0 Jul 09 23:28:17.826994 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.826977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerDied","Data":"78b51a4039e0a5706455d5d336c7935faba03b48cdc4e9bd7f178c44f04be817"} Jul 09 23:28:17.830355 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.830336 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:28:17.830748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.830710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"4a7d9ce84b7dfc601f2ba95e2129a646bed8bbedbc1145aec02d767a53b29922"} Jul 09 23:28:17.830968 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.830949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:28:17.831137 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.831125 2578 scope.go:117] "RemoveContainer" containerID="fa4f5e4d4f81ee118bbe38b9b27927435d2c5cb7415bc1513ea7c1f09601f8f7" Jul 09 23:28:17.847040 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:17.847021 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:28:18.784038 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.784001 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-slgdv"] Jul 09 23:28:18.784391 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.784144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:18.784391 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:18.784228 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:18.789129 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.789097 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lxnw"] Jul 09 23:28:18.789255 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.789187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:18.789327 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:18.789268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:18.789664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.789644 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kr4rb"] Jul 09 23:28:18.789748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.789728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:18.789826 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:18.789809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:18.836375 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.836355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:28:18.836716 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.836692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" event={"ID":"4c14e169-1d63-4633-aae0-f7f0ce812284","Type":"ContainerStarted","Data":"a52b309e1ab2e6bda1255c76836c946a8e73a7956c1872a838d2b74c66aa46f5"} Jul 09 23:28:18.836797 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.836788 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 23:28:18.836993 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.836977 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:28:18.852347 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.852322 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:28:18.862022 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:18.861983 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" podStartSLOduration=10.878272343999999 podStartE2EDuration="29.861965428s" totalImagesPullingTime="18.983693084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:18.860866916 +0000 UTC m=+29.804780599" watchObservedRunningTime="2026-07-09 23:28:18.861965428 +0000 UTC m=+29.805879112" Jul 09 23:28:19.840392 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:19.840175 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd89832e-5e36-43c1-ac55-44d6349ccf9b" containerID="50070f9c279093434761f5404dbdbfb39709097ddaa6d6768e86bd9a38eff651" exitCode=0 Jul 09 23:28:19.840392 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:19.840248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerDied","Data":"50070f9c279093434761f5404dbdbfb39709097ddaa6d6768e86bd9a38eff651"} Jul 09 23:28:19.840786 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:19.840522 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 23:28:20.167985 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:20.167963 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:28:20.569622 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:20.569597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:20.569766 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:20.569597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:20.569766 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:20.569706 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:20.569867 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:20.569798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:20.569867 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:20.569597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:20.569958 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:20.569893 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:20.845846 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:20.845820 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerStarted","Data":"2cbf83019a15c1ada1679a52fab87a2f1d96b6c3c2c56eeebb55394771b38f44"} Jul 09 23:28:21.849883 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:21.849851 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd89832e-5e36-43c1-ac55-44d6349ccf9b" containerID="2cbf83019a15c1ada1679a52fab87a2f1d96b6c3c2c56eeebb55394771b38f44" exitCode=0 Jul 09 23:28:21.850462 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:21.849924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerDied","Data":"2cbf83019a15c1ada1679a52fab87a2f1d96b6c3c2c56eeebb55394771b38f44"} Jul 09 23:28:21.861238 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:21.861201 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" podUID="4c14e169-1d63-4633-aae0-f7f0ce812284" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 23:28:22.568848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:22.568814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:22.568848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:22.568848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:22.569073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:22.568960 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:22.569073 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:22.568959 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-slgdv" podUID="04aba92d-22f0-4ba7-a3af-f98ecabe63b9" Jul 09 23:28:22.569182 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:22.569095 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr4rb" podUID="9327c044-5bf6-4c2b-9809-ac5d277649a6" Jul 09 23:28:22.569234 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:22.569193 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxnw" podUID="cdedccd6-2839-4b94-834a-ec2879940580" Jul 09 23:28:23.227809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:23.227775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:23.228175 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:23.227819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:23.228175 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.227918 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 23:28:23.228175 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.227969 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret podName:04aba92d-22f0-4ba7-a3af-f98ecabe63b9 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:55.227955294 +0000 UTC m=+66.171868955 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret") pod "global-pull-secret-syncer-slgdv" (UID: "04aba92d-22f0-4ba7-a3af-f98ecabe63b9") : object "kube-system"/"original-pull-secret" not registered Jul 09 23:28:23.228175 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.227919 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:28:23.228175 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.228037 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs podName:9327c044-5bf6-4c2b-9809-ac5d277649a6 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:55.22802435 +0000 UTC m=+66.171938024 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs") pod "network-metrics-daemon-kr4rb" (UID: "9327c044-5bf6-4c2b-9809-ac5d277649a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 23:28:23.428749 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:23.428710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:23.428923 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.428847 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 23:28:23.428923 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.428871 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 23:28:23.428923 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.428884 2578 projected.go:196] Error preparing data for projected volume kube-api-access-542x4 for pod openshift-network-diagnostics/network-check-target-5lxnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:28:23.429044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:23.428948 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4 podName:cdedccd6-2839-4b94-834a-ec2879940580 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:55.428929383 +0000 UTC m=+66.372843066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-542x4" (UniqueName: "kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4") pod "network-check-target-5lxnw" (UID: "cdedccd6-2839-4b94-834a-ec2879940580") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 23:28:24.394612 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.394535 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-128.ec2.internal" event="NodeReady" Jul 09 23:28:24.394981 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.394725 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 23:28:24.429835 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.429785 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6757dfcf4d-hhcfn"] Jul 09 23:28:24.431504 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.431491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.433737 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.433537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 23:28:24.433737 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.433637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 23:28:24.433885 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.433728 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 23:28:24.433885 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.433851 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gjrpj\"" Jul 09 23:28:24.440155 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.440137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 23:28:24.443836 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.443812 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6757dfcf4d-hhcfn"] Jul 09 23:28:24.446971 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.446945 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x42vz"] Jul 09 23:28:24.448524 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.448508 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ftjx9"] Jul 09 23:28:24.448633 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.448620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.450111 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.450097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.450694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.450678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 23:28:24.450759 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.450716 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 23:28:24.450921 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.450910 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8548g\"" Jul 09 23:28:24.452102 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.452084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 23:28:24.452334 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.452318 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 23:28:24.452381 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.452358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 23:28:24.452684 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.452668 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4bz2v\"" Jul 09 23:28:24.459060 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.459042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ftjx9"] Jul 09 23:28:24.459802 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.459773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x42vz"] Jul 09 23:28:24.537503 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-trusted-ca\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.537503 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/727cf0c4-0e31-47bf-82f6-902f8b4f4788-config-volume\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.537724 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-installation-pull-secrets\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.537724 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.537724 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pc8\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-kube-api-access-x2pc8\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.537724 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1202104-1f50-4ce0-b150-0547eef9fb04-cert\") pod \"ingress-canary-ftjx9\" (UID: \"e1202104-1f50-4ce0-b150-0547eef9fb04\") " pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.537859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ft5c\" (UniqueName: \"kubernetes.io/projected/727cf0c4-0e31-47bf-82f6-902f8b4f4788-kube-api-access-7ft5c\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.537859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-bound-sa-token\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.537859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727cf0c4-0e31-47bf-82f6-902f8b4f4788-tmp-dir\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.537954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmcs\" (UniqueName: \"kubernetes.io/projected/e1202104-1f50-4ce0-b150-0547eef9fb04-kube-api-access-gxmcs\") pod \"ingress-canary-ftjx9\" (UID: \"e1202104-1f50-4ce0-b150-0547eef9fb04\") " pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.537954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-image-registry-private-configuration\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.537954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.537954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee357c63-71eb-46a4-9865-aae01ff6e4cc-ca-trust-extracted\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.538123 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.537970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-certificates\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.568719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.568620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:24.568719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.568666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:24.568719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.568666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:24.571409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.571204 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 23:28:24.571409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.571245 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 23:28:24.571409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.571251 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rpsb\"" Jul 09 23:28:24.571409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.571266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r9l9m\"" Jul 09 23:28:24.571409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.571248 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 23:28:24.571409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.571204 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 23:28:24.638954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.638925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmcs\" (UniqueName: \"kubernetes.io/projected/e1202104-1f50-4ce0-b150-0547eef9fb04-kube-api-access-gxmcs\") pod \"ingress-canary-ftjx9\" (UID: \"e1202104-1f50-4ce0-b150-0547eef9fb04\") " pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.638954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.638963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-image-registry-private-configuration\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.639197 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.639015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.639197 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.639043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee357c63-71eb-46a4-9865-aae01ff6e4cc-ca-trust-extracted\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.639197 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.639094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-certificates\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.639197 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:24.639129 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 23:28:24.639197 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:24.639151 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6757dfcf4d-hhcfn: secret "image-registry-tls" not found Jul 09 23:28:24.639437 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:24.639213 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls podName:ee357c63-71eb-46a4-9865-aae01ff6e4cc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:25.139191531 +0000 UTC m=+36.083105212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls") pod "image-registry-6757dfcf4d-hhcfn" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc") : secret "image-registry-tls" not found Jul 09 23:28:24.639437 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.639134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-trusted-ca\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.639437 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.639354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/727cf0c4-0e31-47bf-82f6-902f8b4f4788-config-volume\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.640185 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-installation-pull-secrets\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.640307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.640307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pc8\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-kube-api-access-x2pc8\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.640307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640301 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1202104-1f50-4ce0-b150-0547eef9fb04-cert\") pod \"ingress-canary-ftjx9\" (UID: \"e1202104-1f50-4ce0-b150-0547eef9fb04\") " pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.640455 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ft5c\" (UniqueName: \"kubernetes.io/projected/727cf0c4-0e31-47bf-82f6-902f8b4f4788-kube-api-access-7ft5c\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.640455 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640389 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee357c63-71eb-46a4-9865-aae01ff6e4cc-ca-trust-extracted\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.640455 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-bound-sa-token\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.640582 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727cf0c4-0e31-47bf-82f6-902f8b4f4788-tmp-dir\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.640930 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-certificates\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.640930 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.640799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727cf0c4-0e31-47bf-82f6-902f8b4f4788-tmp-dir\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.641236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.641212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-trusted-ca\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.641533 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.641512 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/727cf0c4-0e31-47bf-82f6-902f8b4f4788-config-volume\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.641744 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:24.641725 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 23:28:24.641830 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:24.641817 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls podName:727cf0c4-0e31-47bf-82f6-902f8b4f4788 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:25.141797141 +0000 UTC m=+36.085710818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls") pod "dns-default-x42vz" (UID: "727cf0c4-0e31-47bf-82f6-902f8b4f4788") : secret "dns-default-metrics-tls" not found Jul 09 23:28:24.646625 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.646510 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-installation-pull-secrets\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.646625 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.646541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1202104-1f50-4ce0-b150-0547eef9fb04-cert\") pod \"ingress-canary-ftjx9\" (UID: \"e1202104-1f50-4ce0-b150-0547eef9fb04\") " pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.648224 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.648201 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-image-registry-private-configuration\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.649322 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.649299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmcs\" (UniqueName: \"kubernetes.io/projected/e1202104-1f50-4ce0-b150-0547eef9fb04-kube-api-access-gxmcs\") pod \"ingress-canary-ftjx9\" (UID: \"e1202104-1f50-4ce0-b150-0547eef9fb04\") " pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.652697 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.652669 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-bound-sa-token\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.653036 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.653013 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pc8\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-kube-api-access-x2pc8\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:24.653238 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.653217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ft5c\" (UniqueName: \"kubernetes.io/projected/727cf0c4-0e31-47bf-82f6-902f8b4f4788-kube-api-access-7ft5c\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:24.763059 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.763024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ftjx9" Jul 09 23:28:24.911607 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:24.911530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ftjx9"] Jul 09 23:28:24.915902 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:24.915873 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1202104_1f50_4ce0_b150_0547eef9fb04.slice/crio-879da826ae6de1c55ac68a679588067c1b83b2e92c50675e1e00b954b58e5f33 WatchSource:0}: Error finding container 879da826ae6de1c55ac68a679588067c1b83b2e92c50675e1e00b954b58e5f33: Status 404 returned error can't find the container with id 879da826ae6de1c55ac68a679588067c1b83b2e92c50675e1e00b954b58e5f33 Jul 09 23:28:25.145232 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:25.145189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:25.145515 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:25.145260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:25.145515 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:25.145381 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 23:28:25.145515 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:25.145400 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6757dfcf4d-hhcfn: secret "image-registry-tls" not found Jul 09 23:28:25.145515 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:25.145400 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 23:28:25.145515 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:25.145463 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls podName:ee357c63-71eb-46a4-9865-aae01ff6e4cc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:26.145442264 +0000 UTC m=+37.089355927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls") pod "image-registry-6757dfcf4d-hhcfn" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc") : secret "image-registry-tls" not found Jul 09 23:28:25.145515 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:25.145483 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls podName:727cf0c4-0e31-47bf-82f6-902f8b4f4788 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:26.145473262 +0000 UTC m=+37.089386923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls") pod "dns-default-x42vz" (UID: "727cf0c4-0e31-47bf-82f6-902f8b4f4788") : secret "dns-default-metrics-tls" not found Jul 09 23:28:25.860934 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:25.860891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ftjx9" event={"ID":"e1202104-1f50-4ce0-b150-0547eef9fb04","Type":"ContainerStarted","Data":"879da826ae6de1c55ac68a679588067c1b83b2e92c50675e1e00b954b58e5f33"} Jul 09 23:28:26.024841 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.024801 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8"] Jul 09 23:28:26.029697 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.029661 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s"] Jul 09 23:28:26.029829 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.029780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.031995 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.031971 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 23:28:26.032109 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.032012 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 23:28:26.032201 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.032183 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.032313 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.032270 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ttw8z\"" Jul 09 23:28:26.032784 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.032767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.033193 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.033174 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm"] Jul 09 23:28:26.033359 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.033330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.035455 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.035257 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.035455 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.035294 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 23:28:26.035599 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.035557 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 23:28:26.035719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.035694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.036804 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.036773 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2jk6z\"" Jul 09 23:28:26.037538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.037318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" Jul 09 23:28:26.037538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.037413 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8"] Jul 09 23:28:26.043566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.043410 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.043566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.043439 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.043566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.043567 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tgc6g\"" Jul 09 23:28:26.045085 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.045062 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm"] Jul 09 23:28:26.045639 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.045588 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s"] Jul 09 23:28:26.127071 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.126992 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg"] Jul 09 23:28:26.130664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.130632 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv"] Jul 09 23:28:26.130797 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.130744 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.133059 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.133029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 23:28:26.133059 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.133029 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.133756 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.133456 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.133756 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.133594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6vljz\"" Jul 09 23:28:26.133946 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.133927 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s5pz5"] Jul 09 23:28:26.134148 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.134125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" Jul 09 23:28:26.136179 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.136158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x2fs9\"" Jul 09 23:28:26.136785 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.136767 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q9tg5"] Jul 09 23:28:26.136914 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.136900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.140773 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.140058 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.140773 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.140317 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xwjf4\"" Jul 09 23:28:26.140773 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.140685 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 23:28:26.140773 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.140758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 23:28:26.142817 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.141612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.148989 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.148871 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56cc9f674b-6nzbm"] Jul 09 23:28:26.150138 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.150033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.152118 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c612c13b-6047-4998-9056-fb397100f38e-config\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.152209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kqg4m\"" Jul 09 23:28:26.152209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24wv2\" (UniqueName: \"kubernetes.io/projected/cbf32290-dc86-4302-8577-c0380098441f-kube-api-access-24wv2\") pod \"volume-data-source-validator-78495597f6-w6bgm\" (UID: \"cbf32290-dc86-4302-8577-c0380098441f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" Jul 09 23:28:26.152209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnpzg\" (UniqueName: \"kubernetes.io/projected/c612c13b-6047-4998-9056-fb397100f38e-kube-api-access-nnpzg\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.152209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62fhp\" (UniqueName: \"kubernetes.io/projected/672628e9-b64d-44be-b21e-654b8af50047-kube-api-access-62fhp\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.152440 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152222 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c612c13b-6047-4998-9056-fb397100f38e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.152440 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:26.152440 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.152400 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 23:28:26.152440 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.152422 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6757dfcf4d-hhcfn: secret "image-registry-tls" not found Jul 09 23:28:26.152639 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.152477 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 23:28:26.152639 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:26.152639 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.152483 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls podName:ee357c63-71eb-46a4-9865-aae01ff6e4cc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:28.152463114 +0000 UTC m=+39.096376792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls") pod "image-registry-6757dfcf4d-hhcfn" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc") : secret "image-registry-tls" not found Jul 09 23:28:26.152639 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.152551 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls podName:727cf0c4-0e31-47bf-82f6-902f8b4f4788 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:28.152534978 +0000 UTC m=+39.096448644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls") pod "dns-default-x42vz" (UID: "727cf0c4-0e31-47bf-82f6-902f8b4f4788") : secret "dns-default-metrics-tls" not found Jul 09 23:28:26.152639 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/672628e9-b64d-44be-b21e-654b8af50047-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.152639 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/672628e9-b64d-44be-b21e-654b8af50047-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.152932 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152732 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 23:28:26.153004 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.152965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 23:28:26.154709 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.154691 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 23:28:26.154988 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.154966 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg"] Jul 09 23:28:26.155089 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.155013 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv"] Jul 09 23:28:26.155089 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.155038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q9tg5"] Jul 09 23:28:26.155089 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.155058 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s5pz5"] Jul 09 23:28:26.155224 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.155144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.157273 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.157224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 23:28:26.157786 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.157769 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 23:28:26.157890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.157868 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-979s4\"" Jul 09 23:28:26.157890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.157882 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.158058 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.157775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 23:28:26.158172 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.158154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.158432 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.158413 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 23:28:26.160880 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.160861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cc9f674b-6nzbm"] Jul 09 23:28:26.253303 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.253470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.253470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-tmp\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.253470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.253470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c612c13b-6047-4998-9056-fb397100f38e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.253690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9hcm\" (UniqueName: \"kubernetes.io/projected/0d79ef5a-48f8-4608-b7cf-7b40ac994667-kube-api-access-z9hcm\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.253690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-snapshots\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.253690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qpbv\" (UniqueName: \"kubernetes.io/projected/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-kube-api-access-4qpbv\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.253690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnpzg\" (UniqueName: \"kubernetes.io/projected/c612c13b-6047-4998-9056-fb397100f38e-kube-api-access-nnpzg\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.253690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bdz8\" (UniqueName: \"kubernetes.io/projected/41d397cf-d97c-48d3-a93b-a39a019c082d-kube-api-access-4bdz8\") pod \"network-check-source-869dcfcdcd-h5kbv\" (UID: \"41d397cf-d97c-48d3-a93b-a39a019c082d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" Jul 09 23:28:26.253928 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24wv2\" (UniqueName: \"kubernetes.io/projected/cbf32290-dc86-4302-8577-c0380098441f-kube-api-access-24wv2\") pod \"volume-data-source-validator-78495597f6-w6bgm\" (UID: \"cbf32290-dc86-4302-8577-c0380098441f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" Jul 09 23:28:26.253928 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-default-certificate\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.253928 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv77l\" (UniqueName: \"kubernetes.io/projected/cd0e2eff-74b5-4e26-90d9-395358c09246-kube-api-access-tv77l\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.253928 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.254139 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.253924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62fhp\" (UniqueName: \"kubernetes.io/projected/672628e9-b64d-44be-b21e-654b8af50047-kube-api-access-62fhp\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.254139 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.254139 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.254317 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/672628e9-b64d-44be-b21e-654b8af50047-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.254317 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-stats-auth\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.254317 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/672628e9-b64d-44be-b21e-654b8af50047-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.254452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.254452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-serving-cert\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.254452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c612c13b-6047-4998-9056-fb397100f38e-config\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.254805 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254784 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/672628e9-b64d-44be-b21e-654b8af50047-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.254896 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.254873 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c612c13b-6047-4998-9056-fb397100f38e-config\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.256941 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.256874 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c612c13b-6047-4998-9056-fb397100f38e-serving-cert\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.256941 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.256879 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/672628e9-b64d-44be-b21e-654b8af50047-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.261427 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.261403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnpzg\" (UniqueName: \"kubernetes.io/projected/c612c13b-6047-4998-9056-fb397100f38e-kube-api-access-nnpzg\") pod \"service-ca-operator-7695fc6c8c-7dbb8\" (UID: \"c612c13b-6047-4998-9056-fb397100f38e\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.261666 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.261642 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fhp\" (UniqueName: \"kubernetes.io/projected/672628e9-b64d-44be-b21e-654b8af50047-kube-api-access-62fhp\") pod \"kube-storage-version-migrator-operator-799cb7f958-v5j9s\" (UID: \"672628e9-b64d-44be-b21e-654b8af50047\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.261797 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.261768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24wv2\" (UniqueName: \"kubernetes.io/projected/cbf32290-dc86-4302-8577-c0380098441f-kube-api-access-24wv2\") pod \"volume-data-source-validator-78495597f6-w6bgm\" (UID: \"cbf32290-dc86-4302-8577-c0380098441f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" Jul 09 23:28:26.333785 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.333727 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp"] Jul 09 23:28:26.347187 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.347158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" Jul 09 23:28:26.355203 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" Jul 09 23:28:26.355403 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.355403 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.355403 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-tmp\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.355598 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.355598 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.355492 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 23:28:26.355598 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9hcm\" (UniqueName: \"kubernetes.io/projected/0d79ef5a-48f8-4608-b7cf-7b40ac994667-kube-api-access-z9hcm\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.355598 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.355548 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:26.855527224 +0000 UTC m=+37.799440911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : configmap references non-existent config key: service-ca.crt Jul 09 23:28:26.355764 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.355636 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert podName:0d374ed3-e2a3-4ad4-a821-73f1f41b8556 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:26.855610257 +0000 UTC m=+37.799523926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9tg5" (UID: "0d374ed3-e2a3-4ad4-a821-73f1f41b8556") : secret "networking-console-plugin-cert" not found Jul 09 23:28:26.355764 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-snapshots\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.355764 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qpbv\" (UniqueName: \"kubernetes.io/projected/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-kube-api-access-4qpbv\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.355879 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-tmp\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.355879 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdz8\" (UniqueName: \"kubernetes.io/projected/41d397cf-d97c-48d3-a93b-a39a019c082d-kube-api-access-4bdz8\") pod \"network-check-source-869dcfcdcd-h5kbv\" (UID: \"41d397cf-d97c-48d3-a93b-a39a019c082d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" Jul 09 23:28:26.355879 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-default-certificate\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.356021 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv77l\" (UniqueName: \"kubernetes.io/projected/cd0e2eff-74b5-4e26-90d9-395358c09246-kube-api-access-tv77l\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.356021 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.356021 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.356021 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.355980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.356214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.356047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-stats-auth\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.356214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.356078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.356214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.356131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-serving-cert\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.356214 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.356192 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 23:28:26.356214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.356205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-nginx-conf\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.356478 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.356236 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:26.856221751 +0000 UTC m=+37.800135428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : secret "router-metrics-certs-default" not found Jul 09 23:28:26.356478 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.356391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-snapshots\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.356579 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.356491 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 23:28:26.356579 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.356533 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls podName:0d79ef5a-48f8-4608-b7cf-7b40ac994667 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:26.856518873 +0000 UTC m=+37.800432549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls") pod "cluster-samples-operator-65db858894-tjdhg" (UID: "0d79ef5a-48f8-4608-b7cf-7b40ac994667") : secret "samples-operator-tls" not found Jul 09 23:28:26.357251 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.357225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.357478 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.357439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.358891 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.358837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-serving-cert\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.359266 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.359246 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-default-certificate\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.359504 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.359485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-stats-auth\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.361213 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.361194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" Jul 09 23:28:26.364981 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.364961 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-8wddq"] Jul 09 23:28:26.365530 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.365124 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.367545 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.367515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.367632 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.367558 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kx5zk\"" Jul 09 23:28:26.367632 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.367613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 23:28:26.367729 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.367645 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 23:28:26.367964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.367946 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.370365 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.369809 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qpbv\" (UniqueName: \"kubernetes.io/projected/6b50f254-b6a1-4c08-9be2-8b3469e57f4a-kube-api-access-4qpbv\") pod \"insights-operator-68d9dd94cf-s5pz5\" (UID: \"6b50f254-b6a1-4c08-9be2-8b3469e57f4a\") " pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.375068 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.374251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv77l\" (UniqueName: \"kubernetes.io/projected/cd0e2eff-74b5-4e26-90d9-395358c09246-kube-api-access-tv77l\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.375068 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.374589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9hcm\" (UniqueName: \"kubernetes.io/projected/0d79ef5a-48f8-4608-b7cf-7b40ac994667-kube-api-access-z9hcm\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.375958 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.375934 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bdz8\" (UniqueName: \"kubernetes.io/projected/41d397cf-d97c-48d3-a93b-a39a019c082d-kube-api-access-4bdz8\") pod \"network-check-source-869dcfcdcd-h5kbv\" (UID: \"41d397cf-d97c-48d3-a93b-a39a019c082d\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" Jul 09 23:28:26.395540 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.395516 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp"] Jul 09 23:28:26.395640 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.395552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8wddq"] Jul 09 23:28:26.395640 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.395616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.408305 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.408251 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:28:26.408413 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.408328 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 23:28:26.408413 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.408328 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q46nl\"" Jul 09 23:28:26.408733 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.408716 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 23:28:26.408808 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.408719 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 23:28:26.412218 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.412200 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 23:28:26.456780 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.456737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7f6db721-b535-4f12-87e8-05e28aa59747-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.456936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.456791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.456936 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.456915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9bp\" (UniqueName: \"kubernetes.io/projected/7f6db721-b535-4f12-87e8-05e28aa59747-kube-api-access-9r9bp\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.459601 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.459562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" Jul 09 23:28:26.469746 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.469719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" Jul 09 23:28:26.557905 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.557868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9bp\" (UniqueName: \"kubernetes.io/projected/7f6db721-b535-4f12-87e8-05e28aa59747-kube-api-access-9r9bp\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.557905 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.557914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-trusted-ca\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.558129 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.557975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-config\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.558190 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.558118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-serving-cert\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.558190 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.558155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxrp\" (UniqueName: \"kubernetes.io/projected/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-kube-api-access-tkxrp\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.558296 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.558264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7f6db721-b535-4f12-87e8-05e28aa59747-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.558351 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.558327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.558497 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.558483 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:26.558551 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.558543 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls podName:7f6db721-b535-4f12-87e8-05e28aa59747 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:27.058523209 +0000 UTC m=+38.002436874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8d2zp" (UID: "7f6db721-b535-4f12-87e8-05e28aa59747") : secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:26.558907 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.558888 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7f6db721-b535-4f12-87e8-05e28aa59747-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.568436 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.568415 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9bp\" (UniqueName: \"kubernetes.io/projected/7f6db721-b535-4f12-87e8-05e28aa59747-kube-api-access-9r9bp\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:26.659684 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.659601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-trusted-ca\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.659684 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.659654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-config\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.659892 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.659702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-serving-cert\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.659892 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.659720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxrp\" (UniqueName: \"kubernetes.io/projected/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-kube-api-access-tkxrp\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.660545 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.660512 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-trusted-ca\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.660734 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.660716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-config\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.662602 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.662581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-serving-cert\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.667812 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.667788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxrp\" (UniqueName: \"kubernetes.io/projected/299ab99b-6b60-4774-b7b9-ddf0a2d66c61-kube-api-access-tkxrp\") pod \"console-operator-7866497494-8wddq\" (UID: \"299ab99b-6b60-4774-b7b9-ddf0a2d66c61\") " pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.706197 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.706155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:26.862147 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.862109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.862156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.862247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862270 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:26.862340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862365 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:27.86234928 +0000 UTC m=+38.806262943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : configmap references non-existent config key: service-ca.crt Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862396 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert podName:0d374ed3-e2a3-4ad4-a821-73f1f41b8556 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:27.862385518 +0000 UTC m=+38.806299190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9tg5" (UID: "0d374ed3-e2a3-4ad4-a821-73f1f41b8556") : secret "networking-console-plugin-cert" not found Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862428 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862466 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:27.862449959 +0000 UTC m=+38.806363626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : secret "router-metrics-certs-default" not found Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862518 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 23:28:26.862606 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:26.862558 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls podName:0d79ef5a-48f8-4608-b7cf-7b40ac994667 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:27.862545424 +0000 UTC m=+38.806459088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls") pod "cluster-samples-operator-65db858894-tjdhg" (UID: "0d79ef5a-48f8-4608-b7cf-7b40ac994667") : secret "samples-operator-tls" not found Jul 09 23:28:27.064910 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:27.064865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:27.065074 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.065012 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:27.065142 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.065080 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls podName:7f6db721-b535-4f12-87e8-05e28aa59747 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:28.065059791 +0000 UTC m=+39.008973455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8d2zp" (UID: "7f6db721-b535-4f12-87e8-05e28aa59747") : secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:27.873788 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:27.873758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:27.873802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:27.873873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.873904 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.873980 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert podName:0d374ed3-e2a3-4ad4-a821-73f1f41b8556 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:29.873957186 +0000 UTC m=+40.817870848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9tg5" (UID: "0d374ed3-e2a3-4ad4-a821-73f1f41b8556") : secret "networking-console-plugin-cert" not found Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.873984 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:27.874007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.874037 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:29.874021032 +0000 UTC m=+40.817934713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : secret "router-metrics-certs-default" not found Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.874078 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.874097 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:29.874086659 +0000 UTC m=+40.818000324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : configmap references non-existent config key: service-ca.crt Jul 09 23:28:27.874260 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:27.874124 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls podName:0d79ef5a-48f8-4608-b7cf-7b40ac994667 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:29.874111568 +0000 UTC m=+40.818025256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls") pod "cluster-samples-operator-65db858894-tjdhg" (UID: "0d79ef5a-48f8-4608-b7cf-7b40ac994667") : secret "samples-operator-tls" not found Jul 09 23:28:28.076038 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.076004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:28.076223 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.076159 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:28.076263 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.076233 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls podName:7f6db721-b535-4f12-87e8-05e28aa59747 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:30.076210882 +0000 UTC m=+41.020124543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8d2zp" (UID: "7f6db721-b535-4f12-87e8-05e28aa59747") : secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:28.176886 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.176850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:28.177037 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.177014 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 23:28:28.177037 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.177035 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6757dfcf4d-hhcfn: secret "image-registry-tls" not found Jul 09 23:28:28.177103 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.177037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:28.177103 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.177088 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls podName:ee357c63-71eb-46a4-9865-aae01ff6e4cc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:32.177071317 +0000 UTC m=+43.120984978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls") pod "image-registry-6757dfcf4d-hhcfn" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc") : secret "image-registry-tls" not found Jul 09 23:28:28.177203 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.177138 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 23:28:28.177203 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:28.177178 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls podName:727cf0c4-0e31-47bf-82f6-902f8b4f4788 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:32.177167958 +0000 UTC m=+43.121081619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls") pod "dns-default-x42vz" (UID: "727cf0c4-0e31-47bf-82f6-902f8b4f4788") : secret "dns-default-metrics-tls" not found Jul 09 23:28:28.601382 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.601091 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm"] Jul 09 23:28:28.604082 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:28.604045 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf32290_dc86_4302_8577_c0380098441f.slice/crio-70555e51dcae2120c8d324df452b45a4290ebb12b1a19034999429acec5988b9 WatchSource:0}: Error finding container 70555e51dcae2120c8d324df452b45a4290ebb12b1a19034999429acec5988b9: Status 404 returned error can't find the container with id 70555e51dcae2120c8d324df452b45a4290ebb12b1a19034999429acec5988b9 Jul 09 23:28:28.619492 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.619357 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8"] Jul 09 23:28:28.622939 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.622030 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s5pz5"] Jul 09 23:28:28.622939 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.622090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8wddq"] Jul 09 23:28:28.625236 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:28.625193 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299ab99b_6b60_4774_b7b9_ddf0a2d66c61.slice/crio-0d84003d3074be186e04ae88bbeb6ae0118a4d0e7118f9a4bc6906a4629bcb05 WatchSource:0}: Error finding container 0d84003d3074be186e04ae88bbeb6ae0118a4d0e7118f9a4bc6906a4629bcb05: Status 404 returned error can't find the container with id 0d84003d3074be186e04ae88bbeb6ae0118a4d0e7118f9a4bc6906a4629bcb05 Jul 09 23:28:28.628141 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:28.627925 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc612c13b_6047_4998_9056_fb397100f38e.slice/crio-6a200507262fa42452f1156147d369a884ed3dbb5995c46731b0b3cd3a4de4dd WatchSource:0}: Error finding container 6a200507262fa42452f1156147d369a884ed3dbb5995c46731b0b3cd3a4de4dd: Status 404 returned error can't find the container with id 6a200507262fa42452f1156147d369a884ed3dbb5995c46731b0b3cd3a4de4dd Jul 09 23:28:28.628141 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.628039 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv"] Jul 09 23:28:28.628463 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:28.628442 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b50f254_b6a1_4c08_9be2_8b3469e57f4a.slice/crio-4e1d67d15ef6c7cd56eeecddf83b515d8504d139118b56a6e24b9d5c24873c25 WatchSource:0}: Error finding container 4e1d67d15ef6c7cd56eeecddf83b515d8504d139118b56a6e24b9d5c24873c25: Status 404 returned error can't find the container with id 4e1d67d15ef6c7cd56eeecddf83b515d8504d139118b56a6e24b9d5c24873c25 Jul 09 23:28:28.630886 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.630863 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s"] Jul 09 23:28:28.631960 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:28.631833 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d397cf_d97c_48d3_a93b_a39a019c082d.slice/crio-62169cb2a11f6afb2172ca8fe907fc1ee1615041992b3823b2fc28d38e07e6e1 WatchSource:0}: Error finding container 62169cb2a11f6afb2172ca8fe907fc1ee1615041992b3823b2fc28d38e07e6e1: Status 404 returned error can't find the container with id 62169cb2a11f6afb2172ca8fe907fc1ee1615041992b3823b2fc28d38e07e6e1 Jul 09 23:28:28.873933 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.873889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ftjx9" event={"ID":"e1202104-1f50-4ce0-b150-0547eef9fb04","Type":"ContainerStarted","Data":"fb02942804d4230291b665eadbdc4530f607883660dee343013ae2d65be91cea"} Jul 09 23:28:28.875174 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.875146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8wddq" event={"ID":"299ab99b-6b60-4774-b7b9-ddf0a2d66c61","Type":"ContainerStarted","Data":"0d84003d3074be186e04ae88bbeb6ae0118a4d0e7118f9a4bc6906a4629bcb05"} Jul 09 23:28:28.877832 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.877811 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd89832e-5e36-43c1-ac55-44d6349ccf9b" containerID="d8710f5d249803287da76d15b91170b720db2c3a063068d26c4a96c3bdf16ea6" exitCode=0 Jul 09 23:28:28.877947 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.877879 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerDied","Data":"d8710f5d249803287da76d15b91170b720db2c3a063068d26c4a96c3bdf16ea6"} Jul 09 23:28:28.879013 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.878985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" event={"ID":"672628e9-b64d-44be-b21e-654b8af50047","Type":"ContainerStarted","Data":"bc09de92b1d0cfcfcd3d7f194fa464c9cad8435e7e4c0049ffa09e67277cc861"} Jul 09 23:28:28.880146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.880125 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" event={"ID":"6b50f254-b6a1-4c08-9be2-8b3469e57f4a","Type":"ContainerStarted","Data":"4e1d67d15ef6c7cd56eeecddf83b515d8504d139118b56a6e24b9d5c24873c25"} Jul 09 23:28:28.881150 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.881131 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" event={"ID":"41d397cf-d97c-48d3-a93b-a39a019c082d","Type":"ContainerStarted","Data":"62169cb2a11f6afb2172ca8fe907fc1ee1615041992b3823b2fc28d38e07e6e1"} Jul 09 23:28:28.882326 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.882303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" event={"ID":"c612c13b-6047-4998-9056-fb397100f38e","Type":"ContainerStarted","Data":"6a200507262fa42452f1156147d369a884ed3dbb5995c46731b0b3cd3a4de4dd"} Jul 09 23:28:28.883850 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.883831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" event={"ID":"cbf32290-dc86-4302-8577-c0380098441f","Type":"ContainerStarted","Data":"70555e51dcae2120c8d324df452b45a4290ebb12b1a19034999429acec5988b9"} Jul 09 23:28:28.890544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:28.890505 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ftjx9" podStartSLOduration=1.408948872 podStartE2EDuration="4.890493002s" totalImagesPullingTime="3.48154413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:28.889453054 +0000 UTC m=+39.833366735" watchObservedRunningTime="2026-07-09 23:28:28.890493002 +0000 UTC m=+39.834406678" Jul 09 23:28:29.892706 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:29.892450 2578 generic.go:356] "Generic (PLEG): container finished" podID="fd89832e-5e36-43c1-ac55-44d6349ccf9b" containerID="3c363d044e4e5371e3faa81281afeca758e703c64333953eb5089728cef3fdd3" exitCode=0 Jul 09 23:28:29.893216 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:29.893144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerDied","Data":"3c363d044e4e5371e3faa81281afeca758e703c64333953eb5089728cef3fdd3"} Jul 09 23:28:29.900206 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:29.900177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:29.900352 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:29.900298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:29.900411 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:29.900394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:29.900475 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:29.900432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:29.900695 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.900663 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:33.900643786 +0000 UTC m=+44.844557454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : configmap references non-existent config key: service-ca.crt Jul 09 23:28:29.901176 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.901157 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 23:28:29.901263 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.901219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:33.901197082 +0000 UTC m=+44.845110749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : secret "router-metrics-certs-default" not found Jul 09 23:28:29.901349 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.901307 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 23:28:29.901401 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.901351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls podName:0d79ef5a-48f8-4608-b7cf-7b40ac994667 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:33.901338514 +0000 UTC m=+44.845252181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls") pod "cluster-samples-operator-65db858894-tjdhg" (UID: "0d79ef5a-48f8-4608-b7cf-7b40ac994667") : secret "samples-operator-tls" not found Jul 09 23:28:29.901459 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.901424 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 23:28:29.901515 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:29.901481 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert podName:0d374ed3-e2a3-4ad4-a821-73f1f41b8556 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:33.901469544 +0000 UTC m=+44.845383212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9tg5" (UID: "0d374ed3-e2a3-4ad4-a821-73f1f41b8556") : secret "networking-console-plugin-cert" not found Jul 09 23:28:30.103544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:30.103305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:30.103709 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:30.103547 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:30.103709 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:30.103609 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls podName:7f6db721-b535-4f12-87e8-05e28aa59747 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:34.103589468 +0000 UTC m=+45.047503132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8d2zp" (UID: "7f6db721-b535-4f12-87e8-05e28aa59747") : secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:30.899170 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:30.899077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" event={"ID":"cbf32290-dc86-4302-8577-c0380098441f","Type":"ContainerStarted","Data":"957179b0ee5c687b79de22992209a5fa43a75e32c62e44d096d418a33d1b3eb7"} Jul 09 23:28:30.904627 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:30.904594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99gjz" event={"ID":"fd89832e-5e36-43c1-ac55-44d6349ccf9b","Type":"ContainerStarted","Data":"516df984e6b48ca91e36a66a9e1a0b121ee4661e5cbb577c9a2ee1954a8c6e00"} Jul 09 23:28:30.914307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:30.914223 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-w6bgm" podStartSLOduration=3.035991632 podStartE2EDuration="4.914202119s" totalImagesPullingTime="1.878210487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:30.912720262 +0000 UTC m=+41.856633951" watchObservedRunningTime="2026-07-09 23:28:30.914202119 +0000 UTC m=+41.858115784" Jul 09 23:28:30.933635 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:30.933568 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-99gjz" podStartSLOduration=17.956248112 podStartE2EDuration="41.933545214s" totalImagesPullingTime="23.977297102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:30.93258621 +0000 UTC m=+41.876499894" watchObservedRunningTime="2026-07-09 23:28:30.933545214 +0000 UTC m=+41.877458900" Jul 09 23:28:32.222039 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:32.222009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:32.222548 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:32.222115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:32.222548 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:32.222199 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 23:28:32.222548 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:32.222222 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6757dfcf4d-hhcfn: secret "image-registry-tls" not found Jul 09 23:28:32.222548 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:32.222227 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 23:28:32.222548 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:32.222309 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls podName:ee357c63-71eb-46a4-9865-aae01ff6e4cc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:40.222275884 +0000 UTC m=+51.166189569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls") pod "image-registry-6757dfcf4d-hhcfn" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc") : secret "image-registry-tls" not found Jul 09 23:28:32.222548 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:32.222326 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls podName:727cf0c4-0e31-47bf-82f6-902f8b4f4788 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:40.22231974 +0000 UTC m=+51.166233401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls") pod "dns-default-x42vz" (UID: "727cf0c4-0e31-47bf-82f6-902f8b4f4788") : secret "dns-default-metrics-tls" not found Jul 09 23:28:33.934478 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:33.934435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:33.934535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:33.934566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.934611 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:33.934650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.934720 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls podName:0d79ef5a-48f8-4608-b7cf-7b40ac994667 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:41.934699349 +0000 UTC m=+52.878613014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls") pod "cluster-samples-operator-65db858894-tjdhg" (UID: "0d79ef5a-48f8-4608-b7cf-7b40ac994667") : secret "samples-operator-tls" not found Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.934819 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.934862 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert podName:0d374ed3-e2a3-4ad4-a821-73f1f41b8556 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:41.93485072 +0000 UTC m=+52.878764389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9tg5" (UID: "0d374ed3-e2a3-4ad4-a821-73f1f41b8556") : secret "networking-console-plugin-cert" not found Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.934927 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:41.934917083 +0000 UTC m=+52.878830746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : configmap references non-existent config key: service-ca.crt Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.934989 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 23:28:33.935044 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:33.935018 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:41.935008232 +0000 UTC m=+52.878921901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : secret "router-metrics-certs-default" not found Jul 09 23:28:34.135889 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:34.135851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:34.136082 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:34.136065 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:34.136211 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:34.136167 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls podName:7f6db721-b535-4f12-87e8-05e28aa59747 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:42.136144811 +0000 UTC m=+53.080058476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8d2zp" (UID: "7f6db721-b535-4f12-87e8-05e28aa59747") : secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:35.922662 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.922510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/0.log" Jul 09 23:28:35.923248 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.922677 2578 generic.go:356] "Generic (PLEG): container finished" podID="299ab99b-6b60-4774-b7b9-ddf0a2d66c61" containerID="0543f4262a7032baa3b089b6ca150b9798d96e2b116368feb43a9e263bc85549" exitCode=255 Jul 09 23:28:35.923248 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.922764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8wddq" event={"ID":"299ab99b-6b60-4774-b7b9-ddf0a2d66c61","Type":"ContainerDied","Data":"0543f4262a7032baa3b089b6ca150b9798d96e2b116368feb43a9e263bc85549"} Jul 09 23:28:35.923384 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.923319 2578 scope.go:117] "RemoveContainer" containerID="0543f4262a7032baa3b089b6ca150b9798d96e2b116368feb43a9e263bc85549" Jul 09 23:28:35.924872 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.924699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" event={"ID":"672628e9-b64d-44be-b21e-654b8af50047","Type":"ContainerStarted","Data":"5bc56bb7ef308082da3683caa415c0354fc135713e7667b9e3c7b7abd66f8667"} Jul 09 23:28:35.926528 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.926495 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" event={"ID":"6b50f254-b6a1-4c08-9be2-8b3469e57f4a","Type":"ContainerStarted","Data":"1e56c3ec48348d771e383f4c2acf29cff7cbfbc212762e0b48b5428c4d46af12"} Jul 09 23:28:35.928146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.928107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" event={"ID":"41d397cf-d97c-48d3-a93b-a39a019c082d","Type":"ContainerStarted","Data":"6bb2b9b815ac7c6cbe7dc4f79fedffd6fe9f0ba09445246c79fa80989b252e59"} Jul 09 23:28:35.929660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.929634 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" event={"ID":"c612c13b-6047-4998-9056-fb397100f38e","Type":"ContainerStarted","Data":"fb60a899f51e2a318ecf6320a6ddcd56dfc4625c2e1376f2aad32d03b9a01ad3"} Jul 09 23:28:35.975121 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.975058 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-h5kbv" podStartSLOduration=3.722319156 podStartE2EDuration="9.975037443s" totalImagesPullingTime="6.252718287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:35.972622987 +0000 UTC m=+46.916536670" watchObservedRunningTime="2026-07-09 23:28:35.975037443 +0000 UTC m=+46.918951121" Jul 09 23:28:35.992819 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:35.992766 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" podStartSLOduration=3.753473623 podStartE2EDuration="9.992747616s" totalImagesPullingTime="6.239273993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:35.991411468 +0000 UTC m=+46.935325152" watchObservedRunningTime="2026-07-09 23:28:35.992747616 +0000 UTC m=+46.936661302" Jul 09 23:28:36.010199 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.010138 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" podStartSLOduration=3.762559811 podStartE2EDuration="10.010119033s" totalImagesPullingTime="6.247559222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:36.00967759 +0000 UTC m=+46.953591274" watchObservedRunningTime="2026-07-09 23:28:36.010119033 +0000 UTC m=+46.954032719" Jul 09 23:28:36.025541 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.025473 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" podStartSLOduration=3.779648897 podStartE2EDuration="10.025452348s" totalImagesPullingTime="6.245803451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:36.025251997 +0000 UTC m=+46.969165681" watchObservedRunningTime="2026-07-09 23:28:36.025452348 +0000 UTC m=+46.969366031" Jul 09 23:28:36.101265 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.101229 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jqcrm"] Jul 09 23:28:36.113694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.112781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.115139 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.115109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jqcrm"] Jul 09 23:28:36.115713 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.115691 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qktl8\"" Jul 09 23:28:36.116099 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.116076 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 23:28:36.116301 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.116080 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 23:28:36.154242 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.154210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.154379 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.154313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-crio-socket\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.154379 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.154337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csb72\" (UniqueName: \"kubernetes.io/projected/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-api-access-csb72\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.154469 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.154394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-data-volume\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.154469 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.154431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.255684 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.255600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.255820 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.255691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-crio-socket\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.255820 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.255716 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 23:28:36.255820 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.255719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csb72\" (UniqueName: \"kubernetes.io/projected/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-api-access-csb72\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.255820 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.255784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:36.755762467 +0000 UTC m=+47.699676148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : configmap "kube-rbac-proxy" not found Jul 09 23:28:36.255995 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.255827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-data-volume\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.255995 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.255875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.256083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.255985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-crio-socket\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.256083 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.256051 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 23:28:36.256177 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.256137 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:36.756119687 +0000 UTC m=+47.700033360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : secret "insights-runtime-extractor-tls" not found Jul 09 23:28:36.256266 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.256247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-data-volume\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.265425 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.265300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csb72\" (UniqueName: \"kubernetes.io/projected/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-api-access-csb72\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.706741 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.706706 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:36.706929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.706771 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:36.760621 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.760586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.760803 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.760667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:36.760803 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.760737 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 23:28:36.760803 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.760774 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 23:28:36.760918 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.760823 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:37.760803525 +0000 UTC m=+48.704717194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : secret "insights-runtime-extractor-tls" not found Jul 09 23:28:36.760918 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.760839 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:37.76083344 +0000 UTC m=+48.704747102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : configmap "kube-rbac-proxy" not found Jul 09 23:28:36.934868 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.934840 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:28:36.935477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.935239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/0.log" Jul 09 23:28:36.935477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.935269 2578 generic.go:356] "Generic (PLEG): container finished" podID="299ab99b-6b60-4774-b7b9-ddf0a2d66c61" containerID="ed5d9163255eb42df2a2923a83da1fec2454bbf95f31c4a9eecdb3417873ad8d" exitCode=255 Jul 09 23:28:36.935477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.935325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8wddq" event={"ID":"299ab99b-6b60-4774-b7b9-ddf0a2d66c61","Type":"ContainerDied","Data":"ed5d9163255eb42df2a2923a83da1fec2454bbf95f31c4a9eecdb3417873ad8d"} Jul 09 23:28:36.935477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.935384 2578 scope.go:117] "RemoveContainer" containerID="0543f4262a7032baa3b089b6ca150b9798d96e2b116368feb43a9e263bc85549" Jul 09 23:28:36.935663 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:36.935639 2578 scope.go:117] "RemoveContainer" containerID="ed5d9163255eb42df2a2923a83da1fec2454bbf95f31c4a9eecdb3417873ad8d" Jul 09 23:28:36.935896 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:36.935857 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8wddq_openshift-console-operator(299ab99b-6b60-4774-b7b9-ddf0a2d66c61)\"" pod="openshift-console-operator/console-operator-7866497494-8wddq" podUID="299ab99b-6b60-4774-b7b9-ddf0a2d66c61" Jul 09 23:28:37.768040 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:37.768003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:37.768241 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:37.768071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:37.768241 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:37.768149 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 23:28:37.768241 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:37.768212 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 23:28:37.768415 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:37.768222 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:39.768205603 +0000 UTC m=+50.712119263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : secret "insights-runtime-extractor-tls" not found Jul 09 23:28:37.768415 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:37.768308 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:39.76826902 +0000 UTC m=+50.712182696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : configmap "kube-rbac-proxy" not found Jul 09 23:28:37.940390 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:37.940366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:28:37.940745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:37.940676 2578 scope.go:117] "RemoveContainer" containerID="ed5d9163255eb42df2a2923a83da1fec2454bbf95f31c4a9eecdb3417873ad8d" Jul 09 23:28:37.940829 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:37.940810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8wddq_openshift-console-operator(299ab99b-6b60-4774-b7b9-ddf0a2d66c61)\"" pod="openshift-console-operator/console-operator-7866497494-8wddq" podUID="299ab99b-6b60-4774-b7b9-ddf0a2d66c61" Jul 09 23:28:38.511541 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:38.511509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlrbx_278e24fb-2d93-4155-a625-061bf06dbad6/dns-node-resolver/0.log" Jul 09 23:28:39.514297 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:39.514252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cslvf_a5f0b288-4c39-4817-bcb3-fc65a89a3d74/node-ca/0.log" Jul 09 23:28:39.788298 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:39.788188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:39.788456 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:39.788333 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 23:28:39.788456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:39.788380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:39.788456 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:39.788397 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:43.78838106 +0000 UTC m=+54.732294722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : configmap "kube-rbac-proxy" not found Jul 09 23:28:39.788566 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:39.788457 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 23:28:39.788566 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:39.788512 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:43.788497731 +0000 UTC m=+54.732411411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : secret "insights-runtime-extractor-tls" not found Jul 09 23:28:40.293706 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:40.293674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:40.293890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:40.293801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:40.293890 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:40.293839 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 23:28:40.293890 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:40.293859 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6757dfcf4d-hhcfn: secret "image-registry-tls" not found Jul 09 23:28:40.293890 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:40.293879 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 23:28:40.294010 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:40.293912 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls podName:ee357c63-71eb-46a4-9865-aae01ff6e4cc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:56.293898406 +0000 UTC m=+67.237812079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls") pod "image-registry-6757dfcf4d-hhcfn" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc") : secret "image-registry-tls" not found Jul 09 23:28:40.294010 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:40.293925 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls podName:727cf0c4-0e31-47bf-82f6-902f8b4f4788 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:56.29391893 +0000 UTC m=+67.237832591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls") pod "dns-default-x42vz" (UID: "727cf0c4-0e31-47bf-82f6-902f8b4f4788") : secret "dns-default-metrics-tls" not found Jul 09 23:28:40.311934 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:40.311907 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ftjx9_e1202104-1f50-4ce0-b150-0547eef9fb04/serve-healthcheck-canary/0.log" Jul 09 23:28:40.913458 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:40.913429 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-v5j9s_672628e9-b64d-44be-b21e-654b8af50047/kube-storage-version-migrator-operator/0.log" Jul 09 23:28:42.010592 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:42.010556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:42.010613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010741 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:42.010779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010819 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:58.010797164 +0000 UTC m=+68.954710848 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : secret "router-metrics-certs-default" not found Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010836 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:42.010843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010848 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls podName:0d79ef5a-48f8-4608-b7cf-7b40ac994667 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:58.010877533 +0000 UTC m=+68.954791194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls") pod "cluster-samples-operator-65db858894-tjdhg" (UID: "0d79ef5a-48f8-4608-b7cf-7b40ac994667") : secret "samples-operator-tls" not found Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010954 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert podName:0d374ed3-e2a3-4ad4-a821-73f1f41b8556 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:58.010942943 +0000 UTC m=+68.954856605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-q9tg5" (UID: "0d374ed3-e2a3-4ad4-a821-73f1f41b8556") : secret "networking-console-plugin-cert" not found Jul 09 23:28:42.011072 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.010971 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle podName:cd0e2eff-74b5-4e26-90d9-395358c09246 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:58.010961229 +0000 UTC m=+68.954874890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle") pod "router-default-56cc9f674b-6nzbm" (UID: "cd0e2eff-74b5-4e26-90d9-395358c09246") : configmap references non-existent config key: service-ca.crt Jul 09 23:28:42.212421 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:42.212379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:42.212624 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.212554 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:42.212689 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:42.212633 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls podName:7f6db721-b535-4f12-87e8-05e28aa59747 nodeName:}" failed. No retries permitted until 2026-07-09 23:28:58.212612559 +0000 UTC m=+69.156526220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-8d2zp" (UID: "7f6db721-b535-4f12-87e8-05e28aa59747") : secret "cluster-monitoring-operator-tls" not found Jul 09 23:28:43.829806 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:43.828884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:43.829806 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:43.828986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:43.829806 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:43.829087 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 23:28:43.829806 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:43.829153 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:51.829133876 +0000 UTC m=+62.773047539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : configmap "kube-rbac-proxy" not found Jul 09 23:28:43.829806 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:43.829585 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 23:28:43.829806 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:43.829635 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:28:51.829620705 +0000 UTC m=+62.773534373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : secret "insights-runtime-extractor-tls" not found Jul 09 23:28:46.706858 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.706816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:46.707246 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.706870 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:46.707246 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.707215 2578 scope.go:117] "RemoveContainer" containerID="ed5d9163255eb42df2a2923a83da1fec2454bbf95f31c4a9eecdb3417873ad8d" Jul 09 23:28:46.972076 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.971995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:28:46.972076 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.972045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8wddq" event={"ID":"299ab99b-6b60-4774-b7b9-ddf0a2d66c61","Type":"ContainerStarted","Data":"bf1a1f67104df156d87472a79af3ca1823b114c5967624f78544fadfe7f86ebc"} Jul 09 23:28:46.972335 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.972317 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:46.987921 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:46.987871 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-8wddq" podStartSLOduration=14.738867999 podStartE2EDuration="20.987856391s" totalImagesPullingTime="6.248988392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:46.986545947 +0000 UTC m=+57.930459632" watchObservedRunningTime="2026-07-09 23:28:46.987856391 +0000 UTC m=+57.931770074" Jul 09 23:28:47.381412 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:47.381328 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-8wddq" Jul 09 23:28:51.860019 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:51.859992 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqlq" Jul 09 23:28:51.905437 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:51.905400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:51.905626 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:51.905555 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 23:28:51.905626 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:28:51.905616 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls podName:6c99cbba-b226-4a3b-8df3-241fcbf4ebbc nodeName:}" failed. No retries permitted until 2026-07-09 23:29:07.905599612 +0000 UTC m=+78.849513274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqcrm" (UID: "6c99cbba-b226-4a3b-8df3-241fcbf4ebbc") : secret "insights-runtime-extractor-tls" not found Jul 09 23:28:51.905766 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:51.905723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:51.906241 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:51.906210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:28:55.236870 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.236828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:55.237309 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.236949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:55.239347 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.239329 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 23:28:55.239412 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.239335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 23:28:55.249878 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.249855 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9327c044-5bf6-4c2b-9809-ac5d277649a6-metrics-certs\") pod \"network-metrics-daemon-kr4rb\" (UID: \"9327c044-5bf6-4c2b-9809-ac5d277649a6\") " pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:55.249978 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.249859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04aba92d-22f0-4ba7-a3af-f98ecabe63b9-original-pull-secret\") pod \"global-pull-secret-syncer-slgdv\" (UID: \"04aba92d-22f0-4ba7-a3af-f98ecabe63b9\") " pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:55.438440 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.438398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:55.440823 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.440803 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-542x4\" (UniqueName: \"kubernetes.io/projected/cdedccd6-2839-4b94-834a-ec2879940580-kube-api-access-542x4\") pod \"network-check-target-5lxnw\" (UID: \"cdedccd6-2839-4b94-834a-ec2879940580\") " pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:55.482885 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.482862 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rpsb\"" Jul 09 23:28:55.488510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.488459 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r9l9m\"" Jul 09 23:28:55.491055 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.491036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:55.491151 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.491120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-slgdv" Jul 09 23:28:55.497411 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.497394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr4rb" Jul 09 23:28:55.633317 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.633268 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lxnw"] Jul 09 23:28:55.636994 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:55.636963 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdedccd6_2839_4b94_834a_ec2879940580.slice/crio-e89ea890bd8c6f33652786d1bb62a5ecea3e4fd70927103278e5147e43f41bc7 WatchSource:0}: Error finding container e89ea890bd8c6f33652786d1bb62a5ecea3e4fd70927103278e5147e43f41bc7: Status 404 returned error can't find the container with id e89ea890bd8c6f33652786d1bb62a5ecea3e4fd70927103278e5147e43f41bc7 Jul 09 23:28:55.648615 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.648592 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-slgdv"] Jul 09 23:28:55.651910 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:55.651875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04aba92d_22f0_4ba7_a3af_f98ecabe63b9.slice/crio-9738fdf2f41c4b9bb875b8157585646b39b9c03c911b698990811db48bf13eb7 WatchSource:0}: Error finding container 9738fdf2f41c4b9bb875b8157585646b39b9c03c911b698990811db48bf13eb7: Status 404 returned error can't find the container with id 9738fdf2f41c4b9bb875b8157585646b39b9c03c911b698990811db48bf13eb7 Jul 09 23:28:55.668441 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:55.668419 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kr4rb"] Jul 09 23:28:55.673144 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:55.673121 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9327c044_5bf6_4c2b_9809_ac5d277649a6.slice/crio-3ebda65e99a24769dad01403688098f440a00b6c836c9403f8e50f9851c9710c WatchSource:0}: Error finding container 3ebda65e99a24769dad01403688098f440a00b6c836c9403f8e50f9851c9710c: Status 404 returned error can't find the container with id 3ebda65e99a24769dad01403688098f440a00b6c836c9403f8e50f9851c9710c Jul 09 23:28:56.005976 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.005940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kr4rb" event={"ID":"9327c044-5bf6-4c2b-9809-ac5d277649a6","Type":"ContainerStarted","Data":"3ebda65e99a24769dad01403688098f440a00b6c836c9403f8e50f9851c9710c"} Jul 09 23:28:56.006970 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.006947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-slgdv" event={"ID":"04aba92d-22f0-4ba7-a3af-f98ecabe63b9","Type":"ContainerStarted","Data":"9738fdf2f41c4b9bb875b8157585646b39b9c03c911b698990811db48bf13eb7"} Jul 09 23:28:56.008186 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.008167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lxnw" event={"ID":"cdedccd6-2839-4b94-834a-ec2879940580","Type":"ContainerStarted","Data":"ec23678b1892ff8d3370390811f13836cf9b1777172e795f6ce99bd9e676badb"} Jul 09 23:28:56.008262 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.008201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lxnw" event={"ID":"cdedccd6-2839-4b94-834a-ec2879940580","Type":"ContainerStarted","Data":"e89ea890bd8c6f33652786d1bb62a5ecea3e4fd70927103278e5147e43f41bc7"} Jul 09 23:28:56.008322 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.008312 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:28:56.022905 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.022841 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5lxnw" podStartSLOduration=66.022826501 podStartE2EDuration="1m6.022826501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:56.021769975 +0000 UTC m=+66.965683658" watchObservedRunningTime="2026-07-09 23:28:56.022826501 +0000 UTC m=+66.966740183" Jul 09 23:28:56.346996 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.346925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:56.347438 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.347072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:56.349618 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.349590 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/727cf0c4-0e31-47bf-82f6-902f8b4f4788-metrics-tls\") pod \"dns-default-x42vz\" (UID: \"727cf0c4-0e31-47bf-82f6-902f8b4f4788\") " pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:56.349750 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.349645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"image-registry-6757dfcf4d-hhcfn\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:56.543779 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.543748 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gjrpj\"" Jul 09 23:28:56.551681 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.551651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:56.559210 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.559173 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8548g\"" Jul 09 23:28:56.568007 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.567979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:56.753385 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.753354 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x42vz"] Jul 09 23:28:56.763437 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:56.763406 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727cf0c4_0e31_47bf_82f6_902f8b4f4788.slice/crio-df8a8d984623d7f2c74932477376ffbeb912abf732582903b29125f99f914940 WatchSource:0}: Error finding container df8a8d984623d7f2c74932477376ffbeb912abf732582903b29125f99f914940: Status 404 returned error can't find the container with id df8a8d984623d7f2c74932477376ffbeb912abf732582903b29125f99f914940 Jul 09 23:28:56.775400 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:56.775292 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6757dfcf4d-hhcfn"] Jul 09 23:28:56.778102 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:56.778059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee357c63_71eb_46a4_9865_aae01ff6e4cc.slice/crio-5f1596ccc8574472c7b0d5128306f9666b2ac0b0e218d820bbfd093a7bfb7900 WatchSource:0}: Error finding container 5f1596ccc8574472c7b0d5128306f9666b2ac0b0e218d820bbfd093a7bfb7900: Status 404 returned error can't find the container with id 5f1596ccc8574472c7b0d5128306f9666b2ac0b0e218d820bbfd093a7bfb7900 Jul 09 23:28:57.013895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.013855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kr4rb" event={"ID":"9327c044-5bf6-4c2b-9809-ac5d277649a6","Type":"ContainerStarted","Data":"bcd763df98dd2e76aaa79f6b4f632e7f71d301f56c92b8eebcca4587539c35e5"} Jul 09 23:28:57.014068 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.013919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kr4rb" event={"ID":"9327c044-5bf6-4c2b-9809-ac5d277649a6","Type":"ContainerStarted","Data":"cd27b75ec449eec12064ff76febe03ec63593621f498a767f60c15b880b94926"} Jul 09 23:28:57.015182 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.015154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x42vz" event={"ID":"727cf0c4-0e31-47bf-82f6-902f8b4f4788","Type":"ContainerStarted","Data":"df8a8d984623d7f2c74932477376ffbeb912abf732582903b29125f99f914940"} Jul 09 23:28:57.016919 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.016849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" event={"ID":"ee357c63-71eb-46a4-9865-aae01ff6e4cc","Type":"ContainerStarted","Data":"f1aac06fb2ea54bd29972ae4d1b589fdeab8ed194e761a2fd87545bde936071e"} Jul 09 23:28:57.016919 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.016888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" event={"ID":"ee357c63-71eb-46a4-9865-aae01ff6e4cc","Type":"ContainerStarted","Data":"5f1596ccc8574472c7b0d5128306f9666b2ac0b0e218d820bbfd093a7bfb7900"} Jul 09 23:28:57.017074 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.017057 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:28:57.028663 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.028604 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kr4rb" podStartSLOduration=67.044448791 podStartE2EDuration="1m8.02858149s" totalImagesPullingTime="984.132699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:57.027189142 +0000 UTC m=+67.971102826" watchObservedRunningTime="2026-07-09 23:28:57.02858149 +0000 UTC m=+67.972495174" Jul 09 23:28:57.044588 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:57.044540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" podStartSLOduration=67.044522528 podStartE2EDuration="1m7.044522528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:27:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:57.042789924 +0000 UTC m=+67.986703608" watchObservedRunningTime="2026-07-09 23:28:57.044522528 +0000 UTC m=+67.988436211" Jul 09 23:28:58.066043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.065998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:58.066566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.066080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:58.066566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.066152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:58.066566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.066182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:58.066967 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.066915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0e2eff-74b5-4e26-90d9-395358c09246-service-ca-bundle\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:58.069210 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.069156 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d79ef5a-48f8-4608-b7cf-7b40ac994667-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-tjdhg\" (UID: \"0d79ef5a-48f8-4608-b7cf-7b40ac994667\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:58.069210 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.069179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd0e2eff-74b5-4e26-90d9-395358c09246-metrics-certs\") pod \"router-default-56cc9f674b-6nzbm\" (UID: \"cd0e2eff-74b5-4e26-90d9-395358c09246\") " pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:58.069210 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.069184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d374ed3-e2a3-4ad4-a821-73f1f41b8556-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-q9tg5\" (UID: \"0d374ed3-e2a3-4ad4-a821-73f1f41b8556\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:58.250670 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.250565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-6vljz\"" Jul 09 23:28:58.259594 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.259524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" Jul 09 23:28:58.268313 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.268265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:58.271601 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.271575 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7f6db721-b535-4f12-87e8-05e28aa59747-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-8d2zp\" (UID: \"7f6db721-b535-4f12-87e8-05e28aa59747\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:58.279664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.279638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kqg4m\"" Jul 09 23:28:58.284764 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.284735 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-979s4\"" Jul 09 23:28:58.287369 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.286635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" Jul 09 23:28:58.293839 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.293814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:58.486555 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.486520 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kx5zk\"" Jul 09 23:28:58.494364 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.494332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" Jul 09 23:28:58.743337 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.743297 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56cc9f674b-6nzbm"] Jul 09 23:28:58.746425 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:28:58.746388 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0e2eff_74b5_4e26_90d9_395358c09246.slice/crio-b350e2e5fe02b01c4df84845e9c3f4a091e325ce8989c6a858ab381f4fb30662 WatchSource:0}: Error finding container b350e2e5fe02b01c4df84845e9c3f4a091e325ce8989c6a858ab381f4fb30662: Status 404 returned error can't find the container with id b350e2e5fe02b01c4df84845e9c3f4a091e325ce8989c6a858ab381f4fb30662 Jul 09 23:28:58.902622 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.902587 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp"] Jul 09 23:28:58.905919 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.905893 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-q9tg5"] Jul 09 23:28:58.907163 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:58.907125 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg"] Jul 09 23:28:59.028428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.028334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" event={"ID":"cd0e2eff-74b5-4e26-90d9-395358c09246","Type":"ContainerStarted","Data":"80f7c339144718afd7ecdf98cea7ce20f49b850b2a72dd2d2dd6b90575659620"} Jul 09 23:28:59.028428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.028395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" event={"ID":"cd0e2eff-74b5-4e26-90d9-395358c09246","Type":"ContainerStarted","Data":"b350e2e5fe02b01c4df84845e9c3f4a091e325ce8989c6a858ab381f4fb30662"} Jul 09 23:28:59.030346 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.030321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x42vz" event={"ID":"727cf0c4-0e31-47bf-82f6-902f8b4f4788","Type":"ContainerStarted","Data":"46e73a7fd78e9e1261bcbed52613d01560405e511ec96f8f3395af4f7e98ed2a"} Jul 09 23:28:59.030456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.030370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x42vz" event={"ID":"727cf0c4-0e31-47bf-82f6-902f8b4f4788","Type":"ContainerStarted","Data":"9475ec1ce5cc9ac181e0f0f6298077fc7ac211b9dcf99bbe0062905e667447f5"} Jul 09 23:28:59.030520 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.030475 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x42vz" Jul 09 23:28:59.048767 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.048725 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" podStartSLOduration=33.04871082 podStartE2EDuration="33.04871082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:59.047878143 +0000 UTC m=+69.991791827" watchObservedRunningTime="2026-07-09 23:28:59.04871082 +0000 UTC m=+69.992624503" Jul 09 23:28:59.070152 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.070068 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x42vz" podStartSLOduration=33.273542232 podStartE2EDuration="35.070050515s" totalImagesPullingTime="1.796508283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:28:59.069906338 +0000 UTC m=+70.013820021" watchObservedRunningTime="2026-07-09 23:28:59.070050515 +0000 UTC m=+70.013964198" Jul 09 23:28:59.294661 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.294583 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:28:59.297325 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:28:59.297298 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:29:00.035811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:00.035775 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:29:00.037093 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:00.037067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56cc9f674b-6nzbm" Jul 09 23:29:00.243085 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:00.243049 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6db721_b535_4f12_87e8_05e28aa59747.slice/crio-294479e081b97fe879aec3d9d30d24f17e2afebff6cf667613c5a4877357b680 WatchSource:0}: Error finding container 294479e081b97fe879aec3d9d30d24f17e2afebff6cf667613c5a4877357b680: Status 404 returned error can't find the container with id 294479e081b97fe879aec3d9d30d24f17e2afebff6cf667613c5a4877357b680 Jul 09 23:29:00.243801 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:00.243777 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d374ed3_e2a3_4ad4_a821_73f1f41b8556.slice/crio-84565628a647946213357ccb1834c559f3397462d91f9073f4d61af8bd24a62d WatchSource:0}: Error finding container 84565628a647946213357ccb1834c559f3397462d91f9073f4d61af8bd24a62d: Status 404 returned error can't find the container with id 84565628a647946213357ccb1834c559f3397462d91f9073f4d61af8bd24a62d Jul 09 23:29:01.042535 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:01.042488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" event={"ID":"7f6db721-b535-4f12-87e8-05e28aa59747","Type":"ContainerStarted","Data":"294479e081b97fe879aec3d9d30d24f17e2afebff6cf667613c5a4877357b680"} Jul 09 23:29:01.045423 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:01.045391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-slgdv" event={"ID":"04aba92d-22f0-4ba7-a3af-f98ecabe63b9","Type":"ContainerStarted","Data":"094289d677a9c242f160a7d4bb2d418503c9e0a3a677eac83551c62537956ff6"} Jul 09 23:29:01.047665 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:01.047636 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" event={"ID":"0d374ed3-e2a3-4ad4-a821-73f1f41b8556","Type":"ContainerStarted","Data":"84565628a647946213357ccb1834c559f3397462d91f9073f4d61af8bd24a62d"} Jul 09 23:29:01.049868 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:01.049812 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" event={"ID":"0d79ef5a-48f8-4608-b7cf-7b40ac994667","Type":"ContainerStarted","Data":"4f237c504bcfd94aaa48afd3aedaf052107d4502c0571b880b514a3c807479c9"} Jul 09 23:29:01.059973 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:01.059918 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-slgdv" podStartSLOduration=67.416553405 podStartE2EDuration="1m12.05989953s" totalImagesPullingTime="4.643346125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:01.058978342 +0000 UTC m=+72.002892038" watchObservedRunningTime="2026-07-09 23:29:01.05989953 +0000 UTC m=+72.003813214" Jul 09 23:29:04.063321 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.063261 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" event={"ID":"0d374ed3-e2a3-4ad4-a821-73f1f41b8556","Type":"ContainerStarted","Data":"d9b18c9a7a97a79694de9a6c0a40e556237f1599172883956f3e5b49f09fe61a"} Jul 09 23:29:04.065226 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.065203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" event={"ID":"0d79ef5a-48f8-4608-b7cf-7b40ac994667","Type":"ContainerStarted","Data":"90b648651d0dc85af03d6c11ccfd3d123e822959258413552c069d89468ef1d6"} Jul 09 23:29:04.065369 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.065248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" event={"ID":"0d79ef5a-48f8-4608-b7cf-7b40ac994667","Type":"ContainerStarted","Data":"ae08bbb0c666be26b840bc4c43256850d4ec00008fd3f78012a01d3cf3c14378"} Jul 09 23:29:04.066711 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.066686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" event={"ID":"7f6db721-b535-4f12-87e8-05e28aa59747","Type":"ContainerStarted","Data":"6e48a204f7fc4a8bec2a93208f827174604f7c1e142af26578f45782bc23efef"} Jul 09 23:29:04.078851 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.078805 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-q9tg5" podStartSLOduration=34.931383843 podStartE2EDuration="38.078790568s" totalImagesPullingTime="3.147406725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:04.077976928 +0000 UTC m=+75.021890614" watchObservedRunningTime="2026-07-09 23:29:04.078790568 +0000 UTC m=+75.022704272" Jul 09 23:29:04.116997 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.116943 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-8d2zp" podStartSLOduration=34.969223341 podStartE2EDuration="38.116927334s" totalImagesPullingTime="3.147703993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:04.115869647 +0000 UTC m=+75.059783331" watchObservedRunningTime="2026-07-09 23:29:04.116927334 +0000 UTC m=+75.060841058" Jul 09 23:29:04.117393 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:04.117363 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-tjdhg" podStartSLOduration=35.014811499 podStartE2EDuration="38.117353s" totalImagesPullingTime="3.102541501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:04.097836064 +0000 UTC m=+75.041749748" watchObservedRunningTime="2026-07-09 23:29:04.117353 +0000 UTC m=+75.061266683" Jul 09 23:29:06.468428 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.468395 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7b6f4c44-9kvct"] Jul 09 23:29:06.502719 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.502684 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7b6f4c44-9kvct"] Jul 09 23:29:06.502865 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.502784 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.505171 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.505149 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 23:29:06.505265 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.505157 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 23:29:06.505505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.505491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 23:29:06.505581 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.505540 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 23:29:06.505674 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.505662 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 23:29:06.506064 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.506050 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 23:29:06.506677 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.506660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 23:29:06.506731 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.506682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m97q4\"" Jul 09 23:29:06.640928 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.640896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-oauth-config\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.641112 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.640933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-config\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.641112 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.640958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7pbb\" (UniqueName: \"kubernetes.io/projected/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-kube-api-access-h7pbb\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.641112 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.641023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-serving-cert\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.641112 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.641059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-service-ca\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.641314 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.641121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-oauth-serving-cert\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.741908 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.741822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-oauth-serving-cert\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.741908 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.741889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-oauth-config\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.741926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-config\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.741954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7pbb\" (UniqueName: \"kubernetes.io/projected/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-kube-api-access-h7pbb\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.742029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-serving-cert\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.742070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-service-ca\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742648 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.742624 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-oauth-serving-cert\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742796 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.742745 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-service-ca\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.742796 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.742742 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-config\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.744437 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.744408 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-oauth-config\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.744537 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.744480 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-serving-cert\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.749177 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.749161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7pbb\" (UniqueName: \"kubernetes.io/projected/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-kube-api-access-h7pbb\") pod \"console-7d7b6f4c44-9kvct\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.812887 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.812851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:06.962896 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:06.962861 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7b6f4c44-9kvct"] Jul 09 23:29:06.967113 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:06.967072 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b6a3cb_26c2_4c5e_a7d7_be446abea83f.slice/crio-1d63520552c3c1727213546ef7a54c7a981ff1492b101cc3c9af1e00c1b7e30f WatchSource:0}: Error finding container 1d63520552c3c1727213546ef7a54c7a981ff1492b101cc3c9af1e00c1b7e30f: Status 404 returned error can't find the container with id 1d63520552c3c1727213546ef7a54c7a981ff1492b101cc3c9af1e00c1b7e30f Jul 09 23:29:07.077500 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:07.077416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b6f4c44-9kvct" event={"ID":"64b6a3cb-26c2-4c5e-a7d7-be446abea83f","Type":"ContainerStarted","Data":"1d63520552c3c1727213546ef7a54c7a981ff1492b101cc3c9af1e00c1b7e30f"} Jul 09 23:29:07.952458 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:07.952423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:29:07.954730 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:07.954698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c99cbba-b226-4a3b-8df3-241fcbf4ebbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqcrm\" (UID: \"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc\") " pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:29:08.239602 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:08.239518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qktl8\"" Jul 09 23:29:08.248373 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:08.248347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jqcrm" Jul 09 23:29:08.406799 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:08.406763 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jqcrm"] Jul 09 23:29:08.410947 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:08.410913 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c99cbba_b226_4a3b_8df3_241fcbf4ebbc.slice/crio-be7f5c9f602c36e9b63599479d0f7a9632b00fb3d7703c3558dd32bee71a0332 WatchSource:0}: Error finding container be7f5c9f602c36e9b63599479d0f7a9632b00fb3d7703c3558dd32bee71a0332: Status 404 returned error can't find the container with id be7f5c9f602c36e9b63599479d0f7a9632b00fb3d7703c3558dd32bee71a0332 Jul 09 23:29:09.039604 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:09.038672 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x42vz" Jul 09 23:29:09.092176 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:09.092132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqcrm" event={"ID":"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc","Type":"ContainerStarted","Data":"be7f5c9f602c36e9b63599479d0f7a9632b00fb3d7703c3558dd32bee71a0332"} Jul 09 23:29:13.110746 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:13.110655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqcrm" event={"ID":"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc","Type":"ContainerStarted","Data":"ff6418505f27284857dd885bb1420b5f40797d3f7d1ebfbbdddbc1e21b03162c"} Jul 09 23:29:13.112136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:13.112111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b6f4c44-9kvct" event={"ID":"64b6a3cb-26c2-4c5e-a7d7-be446abea83f","Type":"ContainerStarted","Data":"460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3"} Jul 09 23:29:13.128406 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:13.128262 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7b6f4c44-9kvct" podStartSLOduration=1.307340043 podStartE2EDuration="7.128246863s" totalImagesPullingTime="5.82090682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:13.127476159 +0000 UTC m=+84.071389836" watchObservedRunningTime="2026-07-09 23:29:13.128246863 +0000 UTC m=+84.072160547" Jul 09 23:29:14.118021 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:14.117981 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqcrm" event={"ID":"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc","Type":"ContainerStarted","Data":"4f32d7286a4fa49c625230e49bd8e682b077bca4328b58dc1a100e4ec155ee5e"} Jul 09 23:29:16.130022 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.129931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqcrm" event={"ID":"6c99cbba-b226-4a3b-8df3-241fcbf4ebbc","Type":"ContainerStarted","Data":"fafbd5c6534eb8597c58ae24fdf5d1c201acd350c798d3475a0a01b07dc6b523"} Jul 09 23:29:16.146345 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.146270 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jqcrm" podStartSLOduration=32.876193116 podStartE2EDuration="40.146254022s" totalImagesPullingTime="7.270060906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:28:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:16.146008997 +0000 UTC m=+87.089922682" watchObservedRunningTime="2026-07-09 23:29:16.146254022 +0000 UTC m=+87.090167704" Jul 09 23:29:16.333098 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.333065 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq"] Jul 09 23:29:16.336156 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.336136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.338337 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.338310 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 23:29:16.338456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.338404 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 23:29:16.338456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.338415 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 23:29:16.338456 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.338404 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-c8kjc\"" Jul 09 23:29:16.343749 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.343729 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wfn9j"] Jul 09 23:29:16.345943 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.345922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.346478 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.346459 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq"] Jul 09 23:29:16.348140 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.348124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 23:29:16.348487 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.348463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 23:29:16.348801 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.348762 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 23:29:16.349255 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.349233 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-w9k2t\"" Jul 09 23:29:16.350248 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.350231 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kkxj2"] Jul 09 23:29:16.352687 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.352647 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.354729 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.354701 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mhc8b\"" Jul 09 23:29:16.354921 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.354901 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 23:29:16.355163 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.355147 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 23:29:16.355570 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.355556 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 23:29:16.362939 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.362920 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wfn9j"] Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.426762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b285dbd-5bd6-4e1e-a935-686b352f79c3-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.426991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmfs\" (UniqueName: \"kubernetes.io/projected/3b285dbd-5bd6-4e1e-a935-686b352f79c3-kube-api-access-gkmfs\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.427069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-root\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.427157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.427332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-textfile\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.427613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.430043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.427651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-sys\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.529754 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c43201-6c12-44a5-a42c-e2acc86d9454-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmfs\" (UniqueName: \"kubernetes.io/projected/3b285dbd-5bd6-4e1e-a935-686b352f79c3-kube-api-access-gkmfs\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0ee224-41e6-4819-aaaa-d5644ffef19e-metrics-client-ca\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-root\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw7qm\" (UniqueName: \"kubernetes.io/projected/fc0ee224-41e6-4819-aaaa-d5644ffef19e-kube-api-access-hw7qm\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.529938 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-root\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.529982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:16.530061 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-textfile\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530085 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-wtmp\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530209 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:16.530130 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls podName:3b285dbd-5bd6-4e1e-a935-686b352f79c3 nodeName:}" failed. No retries permitted until 2026-07-09 23:29:17.030109046 +0000 UTC m=+87.974022713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-46tfq" (UID: "3b285dbd-5bd6-4e1e-a935-686b352f79c3") : secret "openshift-state-metrics-tls" not found Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-sys\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b285dbd-5bd6-4e1e-a935-686b352f79c3-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-sys\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57vq\" (UniqueName: \"kubernetes.io/projected/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-api-access-j57vq\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530452 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-textfile\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.530510 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3c43201-6c12-44a5-a42c-e2acc86d9454-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.530973 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.530954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b285dbd-5bd6-4e1e-a935-686b352f79c3-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.532650 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.532628 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.539533 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.539511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmfs\" (UniqueName: \"kubernetes.io/projected/3b285dbd-5bd6-4e1e-a935-686b352f79c3-kube-api-access-gkmfs\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:16.556363 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.556338 2578 patch_prober.go:28] interesting pod/image-registry-6757dfcf4d-hhcfn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 23:29:16.556460 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.556388 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" podUID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 23:29:16.631234 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c43201-6c12-44a5-a42c-e2acc86d9454-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.631234 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0ee224-41e6-4819-aaaa-d5644ffef19e-metrics-client-ca\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7qm\" (UniqueName: \"kubernetes.io/projected/fc0ee224-41e6-4819-aaaa-d5644ffef19e-kube-api-access-hw7qm\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-wtmp\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.631502 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:16.631483 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 23:29:16.631839 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.631839 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57vq\" (UniqueName: \"kubernetes.io/projected/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-api-access-j57vq\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.631839 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:16.631568 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls podName:fc0ee224-41e6-4819-aaaa-d5644ffef19e nodeName:}" failed. No retries permitted until 2026-07-09 23:29:17.13154831 +0000 UTC m=+88.075461977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls") pod "node-exporter-kkxj2" (UID: "fc0ee224-41e6-4819-aaaa-d5644ffef19e") : secret "node-exporter-tls" not found Jul 09 23:29:16.631839 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3c43201-6c12-44a5-a42c-e2acc86d9454-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.631839 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.631868 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc0ee224-41e6-4819-aaaa-d5644ffef19e-metrics-client-ca\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:16.631907 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:16.631967 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-tls podName:c3c43201-6c12-44a5-a42c-e2acc86d9454 nodeName:}" failed. No retries permitted until 2026-07-09 23:29:17.131951445 +0000 UTC m=+88.075865113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-wfn9j" (UID: "c3c43201-6c12-44a5-a42c-e2acc86d9454") : secret "kube-state-metrics-tls" not found Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.632020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-wtmp\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.632043 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3c43201-6c12-44a5-a42c-e2acc86d9454-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.632121 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c43201-6c12-44a5-a42c-e2acc86d9454-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.632499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.632142 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-accelerators-collector-config\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.632772 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.632615 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.633853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.633833 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.633853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.633844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.641782 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.641757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57vq\" (UniqueName: \"kubernetes.io/projected/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-api-access-j57vq\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:16.641866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.641804 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw7qm\" (UniqueName: \"kubernetes.io/projected/fc0ee224-41e6-4819-aaaa-d5644ffef19e-kube-api-access-hw7qm\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:16.813766 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.813686 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:16.813906 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.813786 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:16.818632 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:16.818613 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:17.034991 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.034955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:17.035199 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:17.035123 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 23:29:17.035267 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:17.035204 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls podName:3b285dbd-5bd6-4e1e-a935-686b352f79c3 nodeName:}" failed. No retries permitted until 2026-07-09 23:29:18.035183529 +0000 UTC m=+88.979097192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-46tfq" (UID: "3b285dbd-5bd6-4e1e-a935-686b352f79c3") : secret "openshift-state-metrics-tls" not found Jul 09 23:29:17.136145 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.136067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:17.136145 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.136112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:17.136645 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:17.136203 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 23:29:17.136645 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:29:17.136265 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls podName:fc0ee224-41e6-4819-aaaa-d5644ffef19e nodeName:}" failed. No retries permitted until 2026-07-09 23:29:18.136245623 +0000 UTC m=+89.080159285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls") pod "node-exporter-kkxj2" (UID: "fc0ee224-41e6-4819-aaaa-d5644ffef19e") : secret "node-exporter-tls" not found Jul 09 23:29:17.137659 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.137636 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:29:17.138604 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.138584 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c43201-6c12-44a5-a42c-e2acc86d9454-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wfn9j\" (UID: \"c3c43201-6c12-44a5-a42c-e2acc86d9454\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:17.255797 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.255767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" Jul 09 23:29:17.391765 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:17.391683 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wfn9j"] Jul 09 23:29:17.395347 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:17.395319 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c43201_6c12_44a5_a42c_e2acc86d9454.slice/crio-750d53f58669b2621c3a22da35d753d9b45cb772fa7a9d0ac4c094f4ef9e3778 WatchSource:0}: Error finding container 750d53f58669b2621c3a22da35d753d9b45cb772fa7a9d0ac4c094f4ef9e3778: Status 404 returned error can't find the container with id 750d53f58669b2621c3a22da35d753d9b45cb772fa7a9d0ac4c094f4ef9e3778 Jul 09 23:29:18.027139 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.027107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:29:18.043990 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.043954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:18.046970 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.046941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b285dbd-5bd6-4e1e-a935-686b352f79c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-46tfq\" (UID: \"3b285dbd-5bd6-4e1e-a935-686b352f79c3\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:18.139452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.139412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" event={"ID":"c3c43201-6c12-44a5-a42c-e2acc86d9454","Type":"ContainerStarted","Data":"750d53f58669b2621c3a22da35d753d9b45cb772fa7a9d0ac4c094f4ef9e3778"} Jul 09 23:29:18.145070 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.145045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" Jul 09 23:29:18.145421 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.145396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:18.148192 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.148167 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc0ee224-41e6-4819-aaaa-d5644ffef19e-node-exporter-tls\") pod \"node-exporter-kkxj2\" (UID: \"fc0ee224-41e6-4819-aaaa-d5644ffef19e\") " pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:18.163124 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.163096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kkxj2" Jul 09 23:29:18.175865 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:18.175837 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0ee224_41e6_4819_aaaa_d5644ffef19e.slice/crio-d3db13bc4d0ad2b090ec19ea4ae1f7abdbc3d187a3403bfc3e5307309564c7ed WatchSource:0}: Error finding container d3db13bc4d0ad2b090ec19ea4ae1f7abdbc3d187a3403bfc3e5307309564c7ed: Status 404 returned error can't find the container with id d3db13bc4d0ad2b090ec19ea4ae1f7abdbc3d187a3403bfc3e5307309564c7ed Jul 09 23:29:18.284062 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:18.283977 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq"] Jul 09 23:29:18.287413 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:18.287385 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b285dbd_5bd6_4e1e_a935_686b352f79c3.slice/crio-48def4678c19039a1fb58abc94ec8e234e9880a920d8adcce0eb5cff5ca96d4b WatchSource:0}: Error finding container 48def4678c19039a1fb58abc94ec8e234e9880a920d8adcce0eb5cff5ca96d4b: Status 404 returned error can't find the container with id 48def4678c19039a1fb58abc94ec8e234e9880a920d8adcce0eb5cff5ca96d4b Jul 09 23:29:19.150573 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.150448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkxj2" event={"ID":"fc0ee224-41e6-4819-aaaa-d5644ffef19e","Type":"ContainerStarted","Data":"d3db13bc4d0ad2b090ec19ea4ae1f7abdbc3d187a3403bfc3e5307309564c7ed"} Jul 09 23:29:19.161397 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.161271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" event={"ID":"c3c43201-6c12-44a5-a42c-e2acc86d9454","Type":"ContainerStarted","Data":"1e9c55c2c79fb910542315a31f88f3aeb318b041cc649a593d82904f3b54abe1"} Jul 09 23:29:19.161560 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.161404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" event={"ID":"c3c43201-6c12-44a5-a42c-e2acc86d9454","Type":"ContainerStarted","Data":"7361dcb866a620065dfb07bb97f9ebf5af90c50464470a08a5070e7d2a96d59b"} Jul 09 23:29:19.161560 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.161438 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" event={"ID":"c3c43201-6c12-44a5-a42c-e2acc86d9454","Type":"ContainerStarted","Data":"603028a8c36546b1f73d959274cdf798d7083821b58de3d1d4d3a4c573457d7a"} Jul 09 23:29:19.164574 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.164547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" event={"ID":"3b285dbd-5bd6-4e1e-a935-686b352f79c3","Type":"ContainerStarted","Data":"c0c42f4299fd020bb784b5b7d1e4e1297af3a6aa66138946f2cd431f91c04f36"} Jul 09 23:29:19.164708 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.164592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" event={"ID":"3b285dbd-5bd6-4e1e-a935-686b352f79c3","Type":"ContainerStarted","Data":"c0e865fcac97398f271c0b1d94dd821ac2271cf1b502eea55c3a147f6153dcf5"} Jul 09 23:29:19.164708 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.164618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" event={"ID":"3b285dbd-5bd6-4e1e-a935-686b352f79c3","Type":"ContainerStarted","Data":"48def4678c19039a1fb58abc94ec8e234e9880a920d8adcce0eb5cff5ca96d4b"} Jul 09 23:29:19.178569 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:19.178518 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-wfn9j" podStartSLOduration=1.8028601069999999 podStartE2EDuration="3.178501272s" totalImagesPullingTime="1.375641165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:19.177259631 +0000 UTC m=+90.121173314" watchObservedRunningTime="2026-07-09 23:29:19.178501272 +0000 UTC m=+90.122414933" Jul 09 23:29:20.170400 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.170367 2578 generic.go:356] "Generic (PLEG): container finished" podID="fc0ee224-41e6-4819-aaaa-d5644ffef19e" containerID="336ff9963865118f1dd6dfaca855ca226cb6bbe394d05c8e063bfe471b7cd8ca" exitCode=0 Jul 09 23:29:20.170816 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.170455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkxj2" event={"ID":"fc0ee224-41e6-4819-aaaa-d5644ffef19e","Type":"ContainerDied","Data":"336ff9963865118f1dd6dfaca855ca226cb6bbe394d05c8e063bfe471b7cd8ca"} Jul 09 23:29:20.172544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.172515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" event={"ID":"3b285dbd-5bd6-4e1e-a935-686b352f79c3","Type":"ContainerStarted","Data":"33ecff55c5cbccd53e47b4a0ad60acbe421c1709680fe93ee538c2a6586c37ff"} Jul 09 23:29:20.209296 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.209216 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-46tfq" podStartSLOduration=3.009036238 podStartE2EDuration="4.209200803s" totalImagesPullingTime="1.200164565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:20.209084157 +0000 UTC m=+91.152997840" watchObservedRunningTime="2026-07-09 23:29:20.209200803 +0000 UTC m=+91.153114486" Jul 09 23:29:20.748054 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.748015 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b46b58c59-7vqkb"] Jul 09 23:29:20.750099 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.750075 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.752102 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.752072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 23:29:20.752233 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.752212 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 23:29:20.752309 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.752212 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 23:29:20.753152 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.753135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2job7jn72lf6k\"" Jul 09 23:29:20.753152 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.753145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 23:29:20.753328 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.753197 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7zhl2\"" Jul 09 23:29:20.763957 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.763936 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b46b58c59-7vqkb"] Jul 09 23:29:20.771745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-secret-metrics-server-client-certs\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.771853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/959fdd49-ebd3-471d-ba5c-45766a443b11-metrics-server-audit-profiles\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.771853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/959fdd49-ebd3-471d-ba5c-45766a443b11-kube-api-access-7cw8m\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.771978 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959fdd49-ebd3-471d-ba5c-45766a443b11-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.771978 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/959fdd49-ebd3-471d-ba5c-45766a443b11-audit-log\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.771978 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-client-ca-bundle\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.771978 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.771949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-secret-metrics-server-tls\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872562 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-client-ca-bundle\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872562 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-secret-metrics-server-tls\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872805 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-secret-metrics-server-client-certs\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872805 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/959fdd49-ebd3-471d-ba5c-45766a443b11-metrics-server-audit-profiles\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872805 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/959fdd49-ebd3-471d-ba5c-45766a443b11-kube-api-access-7cw8m\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872805 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959fdd49-ebd3-471d-ba5c-45766a443b11-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.872805 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.872687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/959fdd49-ebd3-471d-ba5c-45766a443b11-audit-log\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.873196 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.873174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/959fdd49-ebd3-471d-ba5c-45766a443b11-audit-log\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.873525 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.873497 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959fdd49-ebd3-471d-ba5c-45766a443b11-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.873713 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.873695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/959fdd49-ebd3-471d-ba5c-45766a443b11-metrics-server-audit-profiles\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.875138 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.875103 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-secret-metrics-server-client-certs\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.875237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.875213 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-client-ca-bundle\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.875237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.875222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/959fdd49-ebd3-471d-ba5c-45766a443b11-secret-metrics-server-tls\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:20.880049 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:20.880027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cw8m\" (UniqueName: \"kubernetes.io/projected/959fdd49-ebd3-471d-ba5c-45766a443b11-kube-api-access-7cw8m\") pod \"metrics-server-6b46b58c59-7vqkb\" (UID: \"959fdd49-ebd3-471d-ba5c-45766a443b11\") " pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:21.062249 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:21.062160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:21.107991 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:21.107954 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6757dfcf4d-hhcfn"] Jul 09 23:29:21.181203 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:21.181088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkxj2" event={"ID":"fc0ee224-41e6-4819-aaaa-d5644ffef19e","Type":"ContainerStarted","Data":"baa91f58610dfa70872a90a2dea940ca08fee3ed734d5c791c8e83890b524275"} Jul 09 23:29:21.181203 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:21.181155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kkxj2" event={"ID":"fc0ee224-41e6-4819-aaaa-d5644ffef19e","Type":"ContainerStarted","Data":"2535d93a729359dd3f1a0aefec1d707c4950b4d26c72f65684b5094744c3d4ea"} Jul 09 23:29:21.199750 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:21.199564 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kkxj2" podStartSLOduration=3.677043706 podStartE2EDuration="5.199542297s" totalImagesPullingTime="1.452531075s" totalInitContainerRuntime="69.967516ms" isStatefulPod=true podCreationTimestamp="2026-07-09 23:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:21.199396242 +0000 UTC m=+92.143309917" watchObservedRunningTime="2026-07-09 23:29:21.199542297 +0000 UTC m=+92.143455981" Jul 09 23:29:21.212735 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:21.212703 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b46b58c59-7vqkb"] Jul 09 23:29:21.215827 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:21.215803 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959fdd49_ebd3_471d_ba5c_45766a443b11.slice/crio-365bca166523d6916004e634c0ceff99a0d459f314762b111c06a5e79fcfbcbc WatchSource:0}: Error finding container 365bca166523d6916004e634c0ceff99a0d459f314762b111c06a5e79fcfbcbc: Status 404 returned error can't find the container with id 365bca166523d6916004e634c0ceff99a0d459f314762b111c06a5e79fcfbcbc Jul 09 23:29:22.187157 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:22.187115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" event={"ID":"959fdd49-ebd3-471d-ba5c-45766a443b11","Type":"ContainerStarted","Data":"365bca166523d6916004e634c0ceff99a0d459f314762b111c06a5e79fcfbcbc"} Jul 09 23:29:23.192813 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:23.192776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" event={"ID":"959fdd49-ebd3-471d-ba5c-45766a443b11","Type":"ContainerStarted","Data":"125fccbd6e77c22cae145670b619d15e0aaa297de61e9d4544b385881a65d010"} Jul 09 23:29:23.208420 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:23.208367 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" podStartSLOduration=1.862255329 podStartE2EDuration="3.208349773s" totalImagesPullingTime="1.346094444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:23.206510696 +0000 UTC m=+94.150424379" watchObservedRunningTime="2026-07-09 23:29:23.208349773 +0000 UTC m=+94.152263456" Jul 09 23:29:25.811827 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.811791 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6957bf554-mtwbw"] Jul 09 23:29:25.814250 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.814228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.820756 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.820730 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 23:29:25.824044 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.824023 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6957bf554-mtwbw"] Jul 09 23:29:25.917624 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-service-ca\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.917795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq4rj\" (UniqueName: \"kubernetes.io/projected/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-kube-api-access-bq4rj\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.917795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-oauth-config\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.917795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-trusted-ca-bundle\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.917795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-oauth-serving-cert\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.917795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-serving-cert\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:25.917951 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:25.917827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-config\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.018650 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-config\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.018822 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-service-ca\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.018822 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq4rj\" (UniqueName: \"kubernetes.io/projected/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-kube-api-access-bq4rj\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.018895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-oauth-config\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.018895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-trusted-ca-bundle\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.018895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-oauth-serving-cert\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.019034 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.018928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-serving-cert\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.019421 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.019398 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-service-ca\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.019536 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.019431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-config\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.019625 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.019605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-oauth-serving-cert\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.019748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.019728 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-trusted-ca-bundle\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.021296 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.021259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-oauth-config\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.021520 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.021499 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-serving-cert\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.025845 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.025820 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq4rj\" (UniqueName: \"kubernetes.io/projected/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-kube-api-access-bq4rj\") pod \"console-6957bf554-mtwbw\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.123846 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.123755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:26.253016 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:26.252966 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6957bf554-mtwbw"] Jul 09 23:29:26.255303 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:29:26.255260 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2a3bc8_a13b_4eb8_a06a_b08b221d4f5d.slice/crio-5890006456a05e8213300f9b085bd3970e74f5c235a83888498a7d0131304f4b WatchSource:0}: Error finding container 5890006456a05e8213300f9b085bd3970e74f5c235a83888498a7d0131304f4b: Status 404 returned error can't find the container with id 5890006456a05e8213300f9b085bd3970e74f5c235a83888498a7d0131304f4b Jul 09 23:29:27.019336 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:27.019304 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5lxnw" Jul 09 23:29:27.212398 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:27.212366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957bf554-mtwbw" event={"ID":"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d","Type":"ContainerStarted","Data":"dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548"} Jul 09 23:29:27.212576 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:27.212418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957bf554-mtwbw" event={"ID":"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d","Type":"ContainerStarted","Data":"5890006456a05e8213300f9b085bd3970e74f5c235a83888498a7d0131304f4b"} Jul 09 23:29:27.227673 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:27.227610 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6957bf554-mtwbw" podStartSLOduration=2.227590568 podStartE2EDuration="2.227590568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:29:27.227185412 +0000 UTC m=+98.171099095" watchObservedRunningTime="2026-07-09 23:29:27.227590568 +0000 UTC m=+98.171504254" Jul 09 23:29:36.123883 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:36.123841 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:36.124367 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:36.123901 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:36.128595 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:36.128573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:36.255700 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:36.255663 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:29:36.302307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:36.302252 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7b6f4c44-9kvct"] Jul 09 23:29:41.062910 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:41.062875 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:41.063320 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:41.062968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:29:41.274139 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:41.274107 2578 generic.go:356] "Generic (PLEG): container finished" podID="672628e9-b64d-44be-b21e-654b8af50047" containerID="5bc56bb7ef308082da3683caa415c0354fc135713e7667b9e3c7b7abd66f8667" exitCode=0 Jul 09 23:29:41.274326 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:41.274187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" event={"ID":"672628e9-b64d-44be-b21e-654b8af50047","Type":"ContainerDied","Data":"5bc56bb7ef308082da3683caa415c0354fc135713e7667b9e3c7b7abd66f8667"} Jul 09 23:29:41.274661 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:41.274647 2578 scope.go:117] "RemoveContainer" containerID="5bc56bb7ef308082da3683caa415c0354fc135713e7667b9e3c7b7abd66f8667" Jul 09 23:29:42.280175 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:42.280138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-v5j9s" event={"ID":"672628e9-b64d-44be-b21e-654b8af50047","Type":"ContainerStarted","Data":"1b34c926690d0767f57bab01435ce4a0fbc8921cab210740af5b2493fdff0e0e"} Jul 09 23:29:46.134856 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.134793 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" podUID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" containerName="registry" containerID="cri-o://f1aac06fb2ea54bd29972ae4d1b589fdeab8ed194e761a2fd87545bde936071e" gracePeriod=30 Jul 09 23:29:46.297403 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.297367 2578 generic.go:356] "Generic (PLEG): container finished" podID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" containerID="f1aac06fb2ea54bd29972ae4d1b589fdeab8ed194e761a2fd87545bde936071e" exitCode=0 Jul 09 23:29:46.297549 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.297432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" event={"ID":"ee357c63-71eb-46a4-9865-aae01ff6e4cc","Type":"ContainerDied","Data":"f1aac06fb2ea54bd29972ae4d1b589fdeab8ed194e761a2fd87545bde936071e"} Jul 09 23:29:46.380693 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.380670 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:29:46.504560 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504516 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-trusted-ca\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504560 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504567 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-installation-pull-secrets\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504594 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee357c63-71eb-46a4-9865-aae01ff6e4cc-ca-trust-extracted\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504629 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-certificates\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504655 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-image-registry-private-configuration\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504700 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504727 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-bound-sa-token\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.504811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.504755 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2pc8\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-kube-api-access-x2pc8\") pod \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\" (UID: \"ee357c63-71eb-46a4-9865-aae01ff6e4cc\") " Jul 09 23:29:46.505094 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.505045 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:29:46.505094 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.505075 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:29:46.507341 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.507298 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:29:46.507577 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.507554 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-kube-api-access-x2pc8" (OuterVolumeSpecName: "kube-api-access-x2pc8") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "kube-api-access-x2pc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:29:46.507577 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.507560 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:29:46.507691 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.507665 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:29:46.507738 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.507671 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:29:46.512830 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.512804 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee357c63-71eb-46a4-9865-aae01ff6e4cc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ee357c63-71eb-46a4-9865-aae01ff6e4cc" (UID: "ee357c63-71eb-46a4-9865-aae01ff6e4cc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:29:46.605569 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605513 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-certificates\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605569 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605563 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-image-registry-private-configuration\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605569 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605579 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-registry-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605808 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605593 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-bound-sa-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605808 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605604 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2pc8\" (UniqueName: \"kubernetes.io/projected/ee357c63-71eb-46a4-9865-aae01ff6e4cc-kube-api-access-x2pc8\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605808 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605617 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee357c63-71eb-46a4-9865-aae01ff6e4cc-trusted-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605808 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605628 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee357c63-71eb-46a4-9865-aae01ff6e4cc-installation-pull-secrets\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:46.605808 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:46.605638 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee357c63-71eb-46a4-9865-aae01ff6e4cc-ca-trust-extracted\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:29:47.303047 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:47.303007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" event={"ID":"ee357c63-71eb-46a4-9865-aae01ff6e4cc","Type":"ContainerDied","Data":"5f1596ccc8574472c7b0d5128306f9666b2ac0b0e218d820bbfd093a7bfb7900"} Jul 09 23:29:47.303525 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:47.303075 2578 scope.go:117] "RemoveContainer" containerID="f1aac06fb2ea54bd29972ae4d1b589fdeab8ed194e761a2fd87545bde936071e" Jul 09 23:29:47.303525 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:47.303021 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6757dfcf4d-hhcfn" Jul 09 23:29:47.322453 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:47.322430 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6757dfcf4d-hhcfn"] Jul 09 23:29:47.327535 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:47.327511 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6757dfcf4d-hhcfn"] Jul 09 23:29:47.574668 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:29:47.574578 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" path="/var/lib/kubelet/pods/ee357c63-71eb-46a4-9865-aae01ff6e4cc/volumes" Jul 09 23:30:01.067715 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.067684 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:30:01.071462 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.071442 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b46b58c59-7vqkb" Jul 09 23:30:01.333171 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.333079 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d7b6f4c44-9kvct" podUID="64b6a3cb-26c2-4c5e-a7d7-be446abea83f" containerName="console" containerID="cri-o://460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3" gracePeriod=15 Jul 09 23:30:01.361158 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.361131 2578 generic.go:356] "Generic (PLEG): container finished" podID="6b50f254-b6a1-4c08-9be2-8b3469e57f4a" containerID="1e56c3ec48348d771e383f4c2acf29cff7cbfbc212762e0b48b5428c4d46af12" exitCode=0 Jul 09 23:30:01.361268 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.361199 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" event={"ID":"6b50f254-b6a1-4c08-9be2-8b3469e57f4a","Type":"ContainerDied","Data":"1e56c3ec48348d771e383f4c2acf29cff7cbfbc212762e0b48b5428c4d46af12"} Jul 09 23:30:01.361608 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.361595 2578 scope.go:117] "RemoveContainer" containerID="1e56c3ec48348d771e383f4c2acf29cff7cbfbc212762e0b48b5428c4d46af12" Jul 09 23:30:01.575620 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.575596 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:30:01.631208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631125 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-config\") pod \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " Jul 09 23:30:01.631208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631157 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7pbb\" (UniqueName: \"kubernetes.io/projected/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-kube-api-access-h7pbb\") pod \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " Jul 09 23:30:01.631208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631174 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-service-ca\") pod \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " Jul 09 23:30:01.631208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631207 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-oauth-serving-cert\") pod \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " Jul 09 23:30:01.631544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631258 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-serving-cert\") pod \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " Jul 09 23:30:01.631544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631334 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-oauth-config\") pod \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\" (UID: \"64b6a3cb-26c2-4c5e-a7d7-be446abea83f\") " Jul 09 23:30:01.631699 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631676 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-service-ca" (OuterVolumeSpecName: "service-ca") pod "64b6a3cb-26c2-4c5e-a7d7-be446abea83f" (UID: "64b6a3cb-26c2-4c5e-a7d7-be446abea83f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:30:01.631756 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631692 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-config" (OuterVolumeSpecName: "console-config") pod "64b6a3cb-26c2-4c5e-a7d7-be446abea83f" (UID: "64b6a3cb-26c2-4c5e-a7d7-be446abea83f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:30:01.631823 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.631798 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "64b6a3cb-26c2-4c5e-a7d7-be446abea83f" (UID: "64b6a3cb-26c2-4c5e-a7d7-be446abea83f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:30:01.633542 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.633518 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "64b6a3cb-26c2-4c5e-a7d7-be446abea83f" (UID: "64b6a3cb-26c2-4c5e-a7d7-be446abea83f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:30:01.633542 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.633524 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-kube-api-access-h7pbb" (OuterVolumeSpecName: "kube-api-access-h7pbb") pod "64b6a3cb-26c2-4c5e-a7d7-be446abea83f" (UID: "64b6a3cb-26c2-4c5e-a7d7-be446abea83f"). InnerVolumeSpecName "kube-api-access-h7pbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:30:01.633730 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.633711 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "64b6a3cb-26c2-4c5e-a7d7-be446abea83f" (UID: "64b6a3cb-26c2-4c5e-a7d7-be446abea83f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:30:01.732471 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.732439 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:30:01.732471 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.732467 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:30:01.732471 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.732476 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:30:01.732694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.732486 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7pbb\" (UniqueName: \"kubernetes.io/projected/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-kube-api-access-h7pbb\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:30:01.732694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.732500 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:30:01.732694 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:01.732510 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64b6a3cb-26c2-4c5e-a7d7-be446abea83f-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:30:02.366111 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.366076 2578 generic.go:356] "Generic (PLEG): container finished" podID="64b6a3cb-26c2-4c5e-a7d7-be446abea83f" containerID="460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3" exitCode=0 Jul 09 23:30:02.366603 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.366118 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7b6f4c44-9kvct" Jul 09 23:30:02.366603 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.366165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b6f4c44-9kvct" event={"ID":"64b6a3cb-26c2-4c5e-a7d7-be446abea83f","Type":"ContainerDied","Data":"460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3"} Jul 09 23:30:02.366603 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.366225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7b6f4c44-9kvct" event={"ID":"64b6a3cb-26c2-4c5e-a7d7-be446abea83f","Type":"ContainerDied","Data":"1d63520552c3c1727213546ef7a54c7a981ff1492b101cc3c9af1e00c1b7e30f"} Jul 09 23:30:02.366603 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.366256 2578 scope.go:117] "RemoveContainer" containerID="460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3" Jul 09 23:30:02.368058 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.368039 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s5pz5" event={"ID":"6b50f254-b6a1-4c08-9be2-8b3469e57f4a","Type":"ContainerStarted","Data":"2e61f350aba673ac90aea0df1d4eabded6712847e875a90ae59569014e470006"} Jul 09 23:30:02.374722 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.374705 2578 scope.go:117] "RemoveContainer" containerID="460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3" Jul 09 23:30:02.374962 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:30:02.374943 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3\": container with ID starting with 460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3 not found: ID does not exist" containerID="460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3" Jul 09 23:30:02.375015 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.374969 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3"} err="failed to get container status \"460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3\": rpc error: code = NotFound desc = could not find container \"460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3\": container with ID starting with 460f6d4831c42f25d09c45bdb080106784dda6dc74ef6bc13010a50db1e0f2f3 not found: ID does not exist" Jul 09 23:30:02.404300 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.400716 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d7b6f4c44-9kvct"] Jul 09 23:30:02.407041 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:02.407011 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d7b6f4c44-9kvct"] Jul 09 23:30:03.574581 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:03.574544 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b6a3cb-26c2-4c5e-a7d7-be446abea83f" path="/var/lib/kubelet/pods/64b6a3cb-26c2-4c5e-a7d7-be446abea83f/volumes" Jul 09 23:30:11.406190 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:11.406153 2578 generic.go:356] "Generic (PLEG): container finished" podID="c612c13b-6047-4998-9056-fb397100f38e" containerID="fb60a899f51e2a318ecf6320a6ddcd56dfc4625c2e1376f2aad32d03b9a01ad3" exitCode=0 Jul 09 23:30:11.406698 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:11.406235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" event={"ID":"c612c13b-6047-4998-9056-fb397100f38e","Type":"ContainerDied","Data":"fb60a899f51e2a318ecf6320a6ddcd56dfc4625c2e1376f2aad32d03b9a01ad3"} Jul 09 23:30:11.406698 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:11.406611 2578 scope.go:117] "RemoveContainer" containerID="fb60a899f51e2a318ecf6320a6ddcd56dfc4625c2e1376f2aad32d03b9a01ad3" Jul 09 23:30:12.412314 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:12.412257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-7dbb8" event={"ID":"c612c13b-6047-4998-9056-fb397100f38e","Type":"ContainerStarted","Data":"c573cc472a666e91893c4f699538b5e75325b03b16ac2ab4ec149235e9648cf0"} Jul 09 23:30:33.423515 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423484 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5985f5bd-t2j94"] Jul 09 23:30:33.424132 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423793 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" containerName="registry" Jul 09 23:30:33.424132 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423805 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" containerName="registry" Jul 09 23:30:33.424132 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423813 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b6a3cb-26c2-4c5e-a7d7-be446abea83f" containerName="console" Jul 09 23:30:33.424132 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423820 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b6a3cb-26c2-4c5e-a7d7-be446abea83f" containerName="console" Jul 09 23:30:33.424132 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423877 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee357c63-71eb-46a4-9865-aae01ff6e4cc" containerName="registry" Jul 09 23:30:33.424132 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.423887 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b6a3cb-26c2-4c5e-a7d7-be446abea83f" containerName="console" Jul 09 23:30:33.428907 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.428884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.456274 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.456240 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5985f5bd-t2j94"] Jul 09 23:30:33.508361 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vrt\" (UniqueName: \"kubernetes.io/projected/be75834e-f883-42e4-b3d5-2734ca1df2e9-kube-api-access-62vrt\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.508540 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-serving-cert\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.508540 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-config\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.508540 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-oauth-config\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.508540 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-trusted-ca-bundle\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.508540 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-service-ca\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.508705 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.508587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-oauth-serving-cert\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.609977 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.609945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-oauth-serving-cert\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.609977 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.609981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vrt\" (UniqueName: \"kubernetes.io/projected/be75834e-f883-42e4-b3d5-2734ca1df2e9-kube-api-access-62vrt\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610230 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-serving-cert\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610230 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-config\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610230 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-oauth-config\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610427 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-trusted-ca-bundle\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610427 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-service-ca\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610822 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-oauth-serving-cert\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610997 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-service-ca\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.610997 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.610990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-config\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.611199 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.611054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-trusted-ca-bundle\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.612597 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.612577 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-serving-cert\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.612680 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.612597 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-oauth-config\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.617183 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.617160 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vrt\" (UniqueName: \"kubernetes.io/projected/be75834e-f883-42e4-b3d5-2734ca1df2e9-kube-api-access-62vrt\") pod \"console-5c5985f5bd-t2j94\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.739216 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.739125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:33.874964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:33.874941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5985f5bd-t2j94"] Jul 09 23:30:33.877125 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:30:33.877090 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe75834e_f883_42e4_b3d5_2734ca1df2e9.slice/crio-6fbf951bcd915c5231151ea0eba5a954e1f0c00c91cba11f10ffb33dd5a4fecb WatchSource:0}: Error finding container 6fbf951bcd915c5231151ea0eba5a954e1f0c00c91cba11f10ffb33dd5a4fecb: Status 404 returned error can't find the container with id 6fbf951bcd915c5231151ea0eba5a954e1f0c00c91cba11f10ffb33dd5a4fecb Jul 09 23:30:34.501236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:34.501192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5985f5bd-t2j94" event={"ID":"be75834e-f883-42e4-b3d5-2734ca1df2e9","Type":"ContainerStarted","Data":"edccbf6ab4634e32d4e361aad5504f90c951c5339c58a196072c6cd124b25fe3"} Jul 09 23:30:34.501647 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:34.501259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5985f5bd-t2j94" event={"ID":"be75834e-f883-42e4-b3d5-2734ca1df2e9","Type":"ContainerStarted","Data":"6fbf951bcd915c5231151ea0eba5a954e1f0c00c91cba11f10ffb33dd5a4fecb"} Jul 09 23:30:34.517774 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:34.517721 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c5985f5bd-t2j94" podStartSLOduration=1.51770104 podStartE2EDuration="1.51770104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:30:34.517158755 +0000 UTC m=+165.461072461" watchObservedRunningTime="2026-07-09 23:30:34.51770104 +0000 UTC m=+165.461614724" Jul 09 23:30:43.739761 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:43.739668 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:43.739761 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:43.739746 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:43.744753 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:43.744731 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:44.548181 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:44.548154 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:30:44.590526 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:30:44.590492 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6957bf554-mtwbw"] Jul 09 23:31:09.612222 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.612158 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6957bf554-mtwbw" podUID="3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" containerName="console" containerID="cri-o://dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548" gracePeriod=15 Jul 09 23:31:09.869432 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.869375 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:31:09.906732 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.906699 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-config\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.906732 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.906733 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-service-ca\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.906968 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.906759 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-oauth-config\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.906968 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.906779 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-trusted-ca-bundle\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.907067 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.906962 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq4rj\" (UniqueName: \"kubernetes.io/projected/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-kube-api-access-bq4rj\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.907067 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907007 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-oauth-serving-cert\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.907168 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907064 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-serving-cert\") pod \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\" (UID: \"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d\") " Jul 09 23:31:09.907168 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907137 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-config" (OuterVolumeSpecName: "console-config") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:31:09.907266 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907171 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:31:09.907266 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907176 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:31:09.907386 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907368 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-trusted-ca-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:09.907422 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907393 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:09.907422 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907389 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:31:09.907422 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.907411 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:09.909251 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.909226 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:31:09.909359 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.909264 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:31:09.909359 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:09.909311 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-kube-api-access-bq4rj" (OuterVolumeSpecName: "kube-api-access-bq4rj") pod "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" (UID: "3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d"). InnerVolumeSpecName "kube-api-access-bq4rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:31:10.008208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.008155 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq4rj\" (UniqueName: \"kubernetes.io/projected/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-kube-api-access-bq4rj\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:10.008208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.008199 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:10.008208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.008209 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:10.008208 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.008218 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:10.644825 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.644787 2578 generic.go:356] "Generic (PLEG): container finished" podID="3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" containerID="dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548" exitCode=0 Jul 09 23:31:10.645237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.644832 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6957bf554-mtwbw" Jul 09 23:31:10.645237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.644873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957bf554-mtwbw" event={"ID":"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d","Type":"ContainerDied","Data":"dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548"} Jul 09 23:31:10.645237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.644925 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6957bf554-mtwbw" event={"ID":"3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d","Type":"ContainerDied","Data":"5890006456a05e8213300f9b085bd3970e74f5c235a83888498a7d0131304f4b"} Jul 09 23:31:10.645237 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.644946 2578 scope.go:117] "RemoveContainer" containerID="dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548" Jul 09 23:31:10.653723 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.653705 2578 scope.go:117] "RemoveContainer" containerID="dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548" Jul 09 23:31:10.653978 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:31:10.653960 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548\": container with ID starting with dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548 not found: ID does not exist" containerID="dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548" Jul 09 23:31:10.654043 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.653985 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548"} err="failed to get container status \"dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548\": rpc error: code = NotFound desc = could not find container \"dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548\": container with ID starting with dc5c2e55c483c2ac2d4f0a754cd11930c79eed5d35221affe653e034d9e4e548 not found: ID does not exist" Jul 09 23:31:10.665191 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.665164 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6957bf554-mtwbw"] Jul 09 23:31:10.668585 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:10.668560 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6957bf554-mtwbw"] Jul 09 23:31:11.575022 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:11.574987 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" path="/var/lib/kubelet/pods/3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d/volumes" Jul 09 23:31:23.879034 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.878992 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58"] Jul 09 23:31:23.879646 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.879468 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" containerName="console" Jul 09 23:31:23.879646 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.879490 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" containerName="console" Jul 09 23:31:23.879646 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.879568 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2a3bc8-a13b-4eb8-a06a-b08b221d4f5d" containerName="console" Jul 09 23:31:23.884012 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.883991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:23.886376 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.886349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 23:31:23.886485 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.886354 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 23:31:23.886485 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.886355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dpkgt\"" Jul 09 23:31:23.889420 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:23.889400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58"] Jul 09 23:31:24.017223 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.017186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tws9h\" (UniqueName: \"kubernetes.io/projected/27ed85ef-3bc0-4d29-bc77-96adf33e981c-kube-api-access-tws9h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.017426 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.017240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.017426 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.017369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.117950 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.117908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.118151 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.118018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tws9h\" (UniqueName: \"kubernetes.io/projected/27ed85ef-3bc0-4d29-bc77-96adf33e981c-kube-api-access-tws9h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.118151 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.118064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.118269 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.118150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.118462 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.118443 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.126255 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.126231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tws9h\" (UniqueName: \"kubernetes.io/projected/27ed85ef-3bc0-4d29-bc77-96adf33e981c-kube-api-access-tws9h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.194018 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.193986 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:24.319063 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.319026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58"] Jul 09 23:31:24.322176 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:31:24.322141 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ed85ef_3bc0_4d29_bc77_96adf33e981c.slice/crio-d66dad73ffd7d5251d1b64f8a2b58bd6700a6a29ba3dbcec432da62b66fad4ba WatchSource:0}: Error finding container d66dad73ffd7d5251d1b64f8a2b58bd6700a6a29ba3dbcec432da62b66fad4ba: Status 404 returned error can't find the container with id d66dad73ffd7d5251d1b64f8a2b58bd6700a6a29ba3dbcec432da62b66fad4ba Jul 09 23:31:24.697081 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:24.697045 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" event={"ID":"27ed85ef-3bc0-4d29-bc77-96adf33e981c","Type":"ContainerStarted","Data":"d66dad73ffd7d5251d1b64f8a2b58bd6700a6a29ba3dbcec432da62b66fad4ba"} Jul 09 23:31:32.732530 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:32.732493 2578 generic.go:356] "Generic (PLEG): container finished" podID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerID="a61b30379a4c9aff457c93514d8eb6b4deed903031c589888f267c15aea2721a" exitCode=0 Jul 09 23:31:32.732953 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:32.732558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" event={"ID":"27ed85ef-3bc0-4d29-bc77-96adf33e981c","Type":"ContainerDied","Data":"a61b30379a4c9aff457c93514d8eb6b4deed903031c589888f267c15aea2721a"} Jul 09 23:31:35.748251 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:35.748214 2578 generic.go:356] "Generic (PLEG): container finished" podID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerID="eb66e13d9dc7abd7010d9c78a68bff4e188ab47d60b272db9da14ac009975131" exitCode=0 Jul 09 23:31:35.748643 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:35.748306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" event={"ID":"27ed85ef-3bc0-4d29-bc77-96adf33e981c","Type":"ContainerDied","Data":"eb66e13d9dc7abd7010d9c78a68bff4e188ab47d60b272db9da14ac009975131"} Jul 09 23:31:43.786173 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:43.786136 2578 generic.go:356] "Generic (PLEG): container finished" podID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerID="b194419ac53886090f92b109a81263e9228008d2bc0fcbe75317bd739a909aa8" exitCode=0 Jul 09 23:31:43.786575 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:43.786188 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" event={"ID":"27ed85ef-3bc0-4d29-bc77-96adf33e981c","Type":"ContainerDied","Data":"b194419ac53886090f92b109a81263e9228008d2bc0fcbe75317bd739a909aa8"} Jul 09 23:31:44.922847 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:44.922822 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:45.007929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.007890 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-bundle\") pod \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " Jul 09 23:31:45.007929 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.007938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tws9h\" (UniqueName: \"kubernetes.io/projected/27ed85ef-3bc0-4d29-bc77-96adf33e981c-kube-api-access-tws9h\") pod \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " Jul 09 23:31:45.008166 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.008003 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-util\") pod \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\" (UID: \"27ed85ef-3bc0-4d29-bc77-96adf33e981c\") " Jul 09 23:31:45.008681 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.008651 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-bundle" (OuterVolumeSpecName: "bundle") pod "27ed85ef-3bc0-4d29-bc77-96adf33e981c" (UID: "27ed85ef-3bc0-4d29-bc77-96adf33e981c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:31:45.010299 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.010254 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ed85ef-3bc0-4d29-bc77-96adf33e981c-kube-api-access-tws9h" (OuterVolumeSpecName: "kube-api-access-tws9h") pod "27ed85ef-3bc0-4d29-bc77-96adf33e981c" (UID: "27ed85ef-3bc0-4d29-bc77-96adf33e981c"). InnerVolumeSpecName "kube-api-access-tws9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:31:45.012383 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.012359 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-util" (OuterVolumeSpecName: "util") pod "27ed85ef-3bc0-4d29-bc77-96adf33e981c" (UID: "27ed85ef-3bc0-4d29-bc77-96adf33e981c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:31:45.109262 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.109184 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:45.109262 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.109215 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tws9h\" (UniqueName: \"kubernetes.io/projected/27ed85ef-3bc0-4d29-bc77-96adf33e981c-kube-api-access-tws9h\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:45.109262 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.109226 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/27ed85ef-3bc0-4d29-bc77-96adf33e981c-util\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:31:45.796244 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.796214 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" Jul 09 23:31:45.796420 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.796245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540btc58" event={"ID":"27ed85ef-3bc0-4d29-bc77-96adf33e981c","Type":"ContainerDied","Data":"d66dad73ffd7d5251d1b64f8a2b58bd6700a6a29ba3dbcec432da62b66fad4ba"} Jul 09 23:31:45.796420 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:45.796338 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d66dad73ffd7d5251d1b64f8a2b58bd6700a6a29ba3dbcec432da62b66fad4ba" Jul 09 23:31:51.599298 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599250 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2"] Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599547 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="pull" Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599558 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="pull" Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599570 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="extract" Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599575 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="extract" Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599585 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="util" Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599590 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="util" Jul 09 23:31:51.599660 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.599645 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ed85ef-3bc0-4d29-bc77-96adf33e981c" containerName="extract" Jul 09 23:31:51.603080 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.603060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.605650 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.605626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:31:51.605795 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.605626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j7xxk\"" Jul 09 23:31:51.605878 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.605796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 23:31:51.614346 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.614323 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2"] Jul 09 23:31:51.760023 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.759980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5klj9\" (UniqueName: \"kubernetes.io/projected/6dd853ba-3170-442e-8383-0498adf04ab1-kube-api-access-5klj9\") pod \"cert-manager-operator-controller-manager-55c444bf86-lvzh2\" (UID: \"6dd853ba-3170-442e-8383-0498adf04ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.760023 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.760019 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dd853ba-3170-442e-8383-0498adf04ab1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lvzh2\" (UID: \"6dd853ba-3170-442e-8383-0498adf04ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.860776 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.860698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5klj9\" (UniqueName: \"kubernetes.io/projected/6dd853ba-3170-442e-8383-0498adf04ab1-kube-api-access-5klj9\") pod \"cert-manager-operator-controller-manager-55c444bf86-lvzh2\" (UID: \"6dd853ba-3170-442e-8383-0498adf04ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.860776 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.860732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dd853ba-3170-442e-8383-0498adf04ab1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lvzh2\" (UID: \"6dd853ba-3170-442e-8383-0498adf04ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.861098 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.861073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dd853ba-3170-442e-8383-0498adf04ab1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lvzh2\" (UID: \"6dd853ba-3170-442e-8383-0498adf04ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.867689 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.867665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5klj9\" (UniqueName: \"kubernetes.io/projected/6dd853ba-3170-442e-8383-0498adf04ab1-kube-api-access-5klj9\") pod \"cert-manager-operator-controller-manager-55c444bf86-lvzh2\" (UID: \"6dd853ba-3170-442e-8383-0498adf04ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:51.912413 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:51.912370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" Jul 09 23:31:52.074261 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:52.074235 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2"] Jul 09 23:31:52.077249 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:31:52.077220 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd853ba_3170_442e_8383_0498adf04ab1.slice/crio-307548accc96a700d019ebd1ae12c1c3861b032b2e3fd6154f4f52a2b26abdfb WatchSource:0}: Error finding container 307548accc96a700d019ebd1ae12c1c3861b032b2e3fd6154f4f52a2b26abdfb: Status 404 returned error can't find the container with id 307548accc96a700d019ebd1ae12c1c3861b032b2e3fd6154f4f52a2b26abdfb Jul 09 23:31:52.828189 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:52.828145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" event={"ID":"6dd853ba-3170-442e-8383-0498adf04ab1","Type":"ContainerStarted","Data":"307548accc96a700d019ebd1ae12c1c3861b032b2e3fd6154f4f52a2b26abdfb"} Jul 09 23:31:53.834168 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:53.834132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" event={"ID":"6dd853ba-3170-442e-8383-0498adf04ab1","Type":"ContainerStarted","Data":"6a1d0b31cfb2906539aee4fc70eb398d770da3c5ba5aec2b871915ef60dd8411"} Jul 09 23:31:53.873422 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:53.873361 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lvzh2" podStartSLOduration=1.303690241 podStartE2EDuration="2.873344418s" totalImagesPullingTime="1.569654177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:31:53.871019827 +0000 UTC m=+244.814933511" watchObservedRunningTime="2026-07-09 23:31:53.873344418 +0000 UTC m=+244.817258100" Jul 09 23:31:58.129385 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.129340 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-84cjg"] Jul 09 23:31:58.131553 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.131526 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.133765 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.133739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 23:31:58.133856 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.133828 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 23:31:58.134610 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.134592 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f7hxh\"" Jul 09 23:31:58.139798 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.139775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-84cjg"] Jul 09 23:31:58.206633 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.206601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7193a36d-eef2-4edb-a702-d14635cc9ddd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-84cjg\" (UID: \"7193a36d-eef2-4edb-a702-d14635cc9ddd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.206799 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.206675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fkxd\" (UniqueName: \"kubernetes.io/projected/7193a36d-eef2-4edb-a702-d14635cc9ddd-kube-api-access-9fkxd\") pod \"cert-manager-cainjector-559cdd8c87-84cjg\" (UID: \"7193a36d-eef2-4edb-a702-d14635cc9ddd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.307843 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.307811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7193a36d-eef2-4edb-a702-d14635cc9ddd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-84cjg\" (UID: \"7193a36d-eef2-4edb-a702-d14635cc9ddd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.308027 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.307896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fkxd\" (UniqueName: \"kubernetes.io/projected/7193a36d-eef2-4edb-a702-d14635cc9ddd-kube-api-access-9fkxd\") pod \"cert-manager-cainjector-559cdd8c87-84cjg\" (UID: \"7193a36d-eef2-4edb-a702-d14635cc9ddd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.315470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.315446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7193a36d-eef2-4edb-a702-d14635cc9ddd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-84cjg\" (UID: \"7193a36d-eef2-4edb-a702-d14635cc9ddd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.315583 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.315538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fkxd\" (UniqueName: \"kubernetes.io/projected/7193a36d-eef2-4edb-a702-d14635cc9ddd-kube-api-access-9fkxd\") pod \"cert-manager-cainjector-559cdd8c87-84cjg\" (UID: \"7193a36d-eef2-4edb-a702-d14635cc9ddd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.455470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.455436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" Jul 09 23:31:58.580394 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.580325 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-84cjg"] Jul 09 23:31:58.582464 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:31:58.582431 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7193a36d_eef2_4edb_a702_d14635cc9ddd.slice/crio-80958b6f7954eb9f5e7d19574bf7d9e2a714717d9b5a4d13e997a8bee0f3bf56 WatchSource:0}: Error finding container 80958b6f7954eb9f5e7d19574bf7d9e2a714717d9b5a4d13e997a8bee0f3bf56: Status 404 returned error can't find the container with id 80958b6f7954eb9f5e7d19574bf7d9e2a714717d9b5a4d13e997a8bee0f3bf56 Jul 09 23:31:58.856603 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:31:58.856529 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" event={"ID":"7193a36d-eef2-4edb-a702-d14635cc9ddd","Type":"ContainerStarted","Data":"80958b6f7954eb9f5e7d19574bf7d9e2a714717d9b5a4d13e997a8bee0f3bf56"} Jul 09 23:32:01.871113 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:01.871076 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" event={"ID":"7193a36d-eef2-4edb-a702-d14635cc9ddd","Type":"ContainerStarted","Data":"d0b6e923516dc8da3a1fb5fdd3170c833334dcf0c39da178e579c6845f923056"} Jul 09 23:32:01.886598 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:01.886543 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84cjg" podStartSLOduration=1.287937613 podStartE2EDuration="3.88652899s" totalImagesPullingTime="2.598591377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:32:01.885233094 +0000 UTC m=+252.829146776" watchObservedRunningTime="2026-07-09 23:32:01.88652899 +0000 UTC m=+252.830442673" Jul 09 23:32:06.793158 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.793123 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-twpn9"] Jul 09 23:32:06.795382 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.795363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:06.797757 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.797738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fpfzj\"" Jul 09 23:32:06.805093 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.805071 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-twpn9"] Jul 09 23:32:06.867811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.867768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlr7r\" (UniqueName: \"kubernetes.io/projected/bc8ec850-8087-45ce-a77e-ae8d090e831c-kube-api-access-tlr7r\") pod \"cert-manager-55b4d954d5-twpn9\" (UID: \"bc8ec850-8087-45ce-a77e-ae8d090e831c\") " pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:06.867811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.867813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc8ec850-8087-45ce-a77e-ae8d090e831c-bound-sa-token\") pod \"cert-manager-55b4d954d5-twpn9\" (UID: \"bc8ec850-8087-45ce-a77e-ae8d090e831c\") " pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:06.969142 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.969106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr7r\" (UniqueName: \"kubernetes.io/projected/bc8ec850-8087-45ce-a77e-ae8d090e831c-kube-api-access-tlr7r\") pod \"cert-manager-55b4d954d5-twpn9\" (UID: \"bc8ec850-8087-45ce-a77e-ae8d090e831c\") " pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:06.969376 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.969158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc8ec850-8087-45ce-a77e-ae8d090e831c-bound-sa-token\") pod \"cert-manager-55b4d954d5-twpn9\" (UID: \"bc8ec850-8087-45ce-a77e-ae8d090e831c\") " pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:06.977101 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.977070 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bc8ec850-8087-45ce-a77e-ae8d090e831c-bound-sa-token\") pod \"cert-manager-55b4d954d5-twpn9\" (UID: \"bc8ec850-8087-45ce-a77e-ae8d090e831c\") " pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:06.977226 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:06.977208 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr7r\" (UniqueName: \"kubernetes.io/projected/bc8ec850-8087-45ce-a77e-ae8d090e831c-kube-api-access-tlr7r\") pod \"cert-manager-55b4d954d5-twpn9\" (UID: \"bc8ec850-8087-45ce-a77e-ae8d090e831c\") " pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:07.104359 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:07.104246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-twpn9" Jul 09 23:32:07.232417 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:07.232391 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-twpn9"] Jul 09 23:32:07.234630 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:32:07.234596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc8ec850_8087_45ce_a77e_ae8d090e831c.slice/crio-92f3e73af4b430ccebcfc9d5c7dda7cb0e169339bc116209a9391a4fc5c95eab WatchSource:0}: Error finding container 92f3e73af4b430ccebcfc9d5c7dda7cb0e169339bc116209a9391a4fc5c95eab: Status 404 returned error can't find the container with id 92f3e73af4b430ccebcfc9d5c7dda7cb0e169339bc116209a9391a4fc5c95eab Jul 09 23:32:07.896786 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:07.896749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-twpn9" event={"ID":"bc8ec850-8087-45ce-a77e-ae8d090e831c","Type":"ContainerStarted","Data":"62ac3fe48b9095be00de7e88dbeef988a2df1ee6aa5b8d034d56f4b29e07023f"} Jul 09 23:32:07.897248 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:07.896797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-twpn9" event={"ID":"bc8ec850-8087-45ce-a77e-ae8d090e831c","Type":"ContainerStarted","Data":"92f3e73af4b430ccebcfc9d5c7dda7cb0e169339bc116209a9391a4fc5c95eab"} Jul 09 23:32:07.911295 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:07.911234 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-twpn9" podStartSLOduration=1.911220062 podStartE2EDuration="1.911220062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:32:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:32:07.90945457 +0000 UTC m=+258.853368267" watchObservedRunningTime="2026-07-09 23:32:07.911220062 +0000 UTC m=+258.855133744" Jul 09 23:32:32.146209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.146169 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw"] Jul 09 23:32:32.149595 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.149576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.151819 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.151800 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 23:32:32.152576 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.152555 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dpkgt\"" Jul 09 23:32:32.152693 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.152579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 23:32:32.156577 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.156549 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw"] Jul 09 23:32:32.266666 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.266629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.266666 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.266677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.266882 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.266712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b549z\" (UniqueName: \"kubernetes.io/projected/c171d452-35f2-4748-8f18-12cc13c82a32-kube-api-access-b549z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.368048 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.368007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.368048 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.368064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.368315 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.368097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b549z\" (UniqueName: \"kubernetes.io/projected/c171d452-35f2-4748-8f18-12cc13c82a32-kube-api-access-b549z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.368457 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.368437 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.368493 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.368460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.375762 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.375736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b549z\" (UniqueName: \"kubernetes.io/projected/c171d452-35f2-4748-8f18-12cc13c82a32-kube-api-access-b549z\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.460002 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.459971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:32.602561 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:32.602532 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw"] Jul 09 23:32:32.605018 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:32:32.604991 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc171d452_35f2_4748_8f18_12cc13c82a32.slice/crio-e3f0a0595e341dc109086fd30e0d00b0a264cbba88193a6bff37af9bf55ac2b2 WatchSource:0}: Error finding container e3f0a0595e341dc109086fd30e0d00b0a264cbba88193a6bff37af9bf55ac2b2: Status 404 returned error can't find the container with id e3f0a0595e341dc109086fd30e0d00b0a264cbba88193a6bff37af9bf55ac2b2 Jul 09 23:32:33.005913 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:33.005873 2578 generic.go:356] "Generic (PLEG): container finished" podID="c171d452-35f2-4748-8f18-12cc13c82a32" containerID="52208a861543a77c3895194c7396261b089ebbc695b20ca3b58ff562e48ffe78" exitCode=0 Jul 09 23:32:33.006083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:33.005913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" event={"ID":"c171d452-35f2-4748-8f18-12cc13c82a32","Type":"ContainerDied","Data":"52208a861543a77c3895194c7396261b089ebbc695b20ca3b58ff562e48ffe78"} Jul 09 23:32:33.006083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:33.005965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" event={"ID":"c171d452-35f2-4748-8f18-12cc13c82a32","Type":"ContainerStarted","Data":"e3f0a0595e341dc109086fd30e0d00b0a264cbba88193a6bff37af9bf55ac2b2"} Jul 09 23:32:34.012643 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:34.012554 2578 generic.go:356] "Generic (PLEG): container finished" podID="c171d452-35f2-4748-8f18-12cc13c82a32" containerID="efc341feba8a2b8ba19ec738fe42117c0a6d8661ab313f68bd0ad55e8d72fe21" exitCode=0 Jul 09 23:32:34.013001 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:34.012636 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" event={"ID":"c171d452-35f2-4748-8f18-12cc13c82a32","Type":"ContainerDied","Data":"efc341feba8a2b8ba19ec738fe42117c0a6d8661ab313f68bd0ad55e8d72fe21"} Jul 09 23:32:35.018733 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:35.018697 2578 generic.go:356] "Generic (PLEG): container finished" podID="c171d452-35f2-4748-8f18-12cc13c82a32" containerID="58bf74742cbd191ab1c379cfb924af943e2199882c529c8de4dbaf837fbabda8" exitCode=0 Jul 09 23:32:35.019098 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:35.018782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" event={"ID":"c171d452-35f2-4748-8f18-12cc13c82a32","Type":"ContainerDied","Data":"58bf74742cbd191ab1c379cfb924af943e2199882c529c8de4dbaf837fbabda8"} Jul 09 23:32:36.154154 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.154119 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:36.210813 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.210773 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-util\") pod \"c171d452-35f2-4748-8f18-12cc13c82a32\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " Jul 09 23:32:36.211008 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.210833 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b549z\" (UniqueName: \"kubernetes.io/projected/c171d452-35f2-4748-8f18-12cc13c82a32-kube-api-access-b549z\") pod \"c171d452-35f2-4748-8f18-12cc13c82a32\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " Jul 09 23:32:36.211008 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.210863 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-bundle\") pod \"c171d452-35f2-4748-8f18-12cc13c82a32\" (UID: \"c171d452-35f2-4748-8f18-12cc13c82a32\") " Jul 09 23:32:36.211677 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.211653 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-bundle" (OuterVolumeSpecName: "bundle") pod "c171d452-35f2-4748-8f18-12cc13c82a32" (UID: "c171d452-35f2-4748-8f18-12cc13c82a32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:32:36.212984 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.212951 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c171d452-35f2-4748-8f18-12cc13c82a32-kube-api-access-b549z" (OuterVolumeSpecName: "kube-api-access-b549z") pod "c171d452-35f2-4748-8f18-12cc13c82a32" (UID: "c171d452-35f2-4748-8f18-12cc13c82a32"). InnerVolumeSpecName "kube-api-access-b549z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:32:36.216552 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.216526 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-util" (OuterVolumeSpecName: "util") pod "c171d452-35f2-4748-8f18-12cc13c82a32" (UID: "c171d452-35f2-4748-8f18-12cc13c82a32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:32:36.312601 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.312505 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-util\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:32:36.312601 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.312546 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b549z\" (UniqueName: \"kubernetes.io/projected/c171d452-35f2-4748-8f18-12cc13c82a32-kube-api-access-b549z\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:32:36.312601 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:36.312559 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c171d452-35f2-4748-8f18-12cc13c82a32-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:32:37.029210 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:37.029173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" event={"ID":"c171d452-35f2-4748-8f18-12cc13c82a32","Type":"ContainerDied","Data":"e3f0a0595e341dc109086fd30e0d00b0a264cbba88193a6bff37af9bf55ac2b2"} Jul 09 23:32:37.029394 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:37.029223 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3f0a0595e341dc109086fd30e0d00b0a264cbba88193a6bff37af9bf55ac2b2" Jul 09 23:32:37.029394 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:37.029223 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw7zmw" Jul 09 23:32:39.517233 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517198 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r"] Jul 09 23:32:39.517814 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517664 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="util" Jul 09 23:32:39.517814 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517687 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="util" Jul 09 23:32:39.517814 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517705 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="pull" Jul 09 23:32:39.517814 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517713 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="pull" Jul 09 23:32:39.517814 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517730 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="extract" Jul 09 23:32:39.517814 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517739 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="extract" Jul 09 23:32:39.518115 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.517834 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c171d452-35f2-4748-8f18-12cc13c82a32" containerName="extract" Jul 09 23:32:39.521978 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.521954 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.525125 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.525102 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 23:32:39.525125 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.525123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2z2tk\"" Jul 09 23:32:39.525323 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.525169 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 23:32:39.525323 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.525126 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 23:32:39.525440 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.525426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 23:32:39.525497 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.525476 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 23:32:39.530397 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.530202 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r"] Jul 09 23:32:39.637538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.637502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0fa01a0-2a10-46ff-8746-072e8804234c-manager-config\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.637538 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.637534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0fa01a0-2a10-46ff-8746-072e8804234c-cert\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.637789 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.637556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gb2\" (UniqueName: \"kubernetes.io/projected/a0fa01a0-2a10-46ff-8746-072e8804234c-kube-api-access-j2gb2\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.637789 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.637696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0fa01a0-2a10-46ff-8746-072e8804234c-metrics-cert\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.738737 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.738699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0fa01a0-2a10-46ff-8746-072e8804234c-manager-config\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.738737 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.738736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0fa01a0-2a10-46ff-8746-072e8804234c-cert\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.738999 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.738756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gb2\" (UniqueName: \"kubernetes.io/projected/a0fa01a0-2a10-46ff-8746-072e8804234c-kube-api-access-j2gb2\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.738999 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.738810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0fa01a0-2a10-46ff-8746-072e8804234c-metrics-cert\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.739406 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.739382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0fa01a0-2a10-46ff-8746-072e8804234c-manager-config\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.741330 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.741308 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0fa01a0-2a10-46ff-8746-072e8804234c-metrics-cert\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.741559 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.741403 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0fa01a0-2a10-46ff-8746-072e8804234c-cert\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.754448 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.754421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gb2\" (UniqueName: \"kubernetes.io/projected/a0fa01a0-2a10-46ff-8746-072e8804234c-kube-api-access-j2gb2\") pod \"lws-controller-manager-7c889b46bf-8p89r\" (UID: \"a0fa01a0-2a10-46ff-8746-072e8804234c\") " pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.833531 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.833442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:39.982854 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:39.982217 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r"] Jul 09 23:32:40.042309 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:40.042262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" event={"ID":"a0fa01a0-2a10-46ff-8746-072e8804234c","Type":"ContainerStarted","Data":"ffc7fead2d245702e5cf449c350eee449145a3ac218c5c813277eb6687084daa"} Jul 09 23:32:43.060495 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:43.060459 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" event={"ID":"a0fa01a0-2a10-46ff-8746-072e8804234c","Type":"ContainerStarted","Data":"9a5d8572865d7482127817e44ad7a4253b9a6d82d15d44518ebb1ca445f387e2"} Jul 09 23:32:43.060885 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:43.060544 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:32:43.076079 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:43.076025 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" podStartSLOduration=1.5540417039999999 podStartE2EDuration="4.076009599s" totalImagesPullingTime="2.521967895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:32:43.075056213 +0000 UTC m=+294.018969894" watchObservedRunningTime="2026-07-09 23:32:43.076009599 +0000 UTC m=+294.019923281" Jul 09 23:32:44.651551 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.651520 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv"] Jul 09 23:32:44.655255 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.655235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.658503 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.658479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 23:32:44.658607 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.658520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 23:32:44.658607 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.658530 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8zrkh\"" Jul 09 23:32:44.659161 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.659137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 23:32:44.659241 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.659155 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 23:32:44.673225 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.673199 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv"] Jul 09 23:32:44.786635 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.786599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f710dc0-07df-42be-88c3-40c9da9e3e37-manifests\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.786809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.786647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f710dc0-07df-42be-88c3-40c9da9e3e37-tmp\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.786809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.786672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866ng\" (UniqueName: \"kubernetes.io/projected/6f710dc0-07df-42be-88c3-40c9da9e3e37-kube-api-access-866ng\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.786809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.786754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f710dc0-07df-42be-88c3-40c9da9e3e37-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.786809 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.786803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f710dc0-07df-42be-88c3-40c9da9e3e37-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.887800 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.887763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f710dc0-07df-42be-88c3-40c9da9e3e37-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.887800 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.887807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f710dc0-07df-42be-88c3-40c9da9e3e37-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.888020 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.887909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f710dc0-07df-42be-88c3-40c9da9e3e37-manifests\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.888020 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.887944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f710dc0-07df-42be-88c3-40c9da9e3e37-tmp\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.888020 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.887965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-866ng\" (UniqueName: \"kubernetes.io/projected/6f710dc0-07df-42be-88c3-40c9da9e3e37-kube-api-access-866ng\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.888444 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.888424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f710dc0-07df-42be-88c3-40c9da9e3e37-manifests\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.890272 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.890242 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f710dc0-07df-42be-88c3-40c9da9e3e37-tmp\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.890446 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.890427 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f710dc0-07df-42be-88c3-40c9da9e3e37-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.890497 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.890476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f710dc0-07df-42be-88c3-40c9da9e3e37-webhook-cert\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.895136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.895113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-866ng\" (UniqueName: \"kubernetes.io/projected/6f710dc0-07df-42be-88c3-40c9da9e3e37-kube-api-access-866ng\") pod \"opendatahub-operator-controller-manager-c55df6879-fnqlv\" (UID: \"6f710dc0-07df-42be-88c3-40c9da9e3e37\") " pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:44.966878 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:44.966849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:45.113576 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:45.113549 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv"] Jul 09 23:32:45.116157 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:32:45.116131 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f710dc0_07df_42be_88c3_40c9da9e3e37.slice/crio-50f4cbce34feb94434f802bb484fb8496807c11813e5645aaa688c57aa0633c3 WatchSource:0}: Error finding container 50f4cbce34feb94434f802bb484fb8496807c11813e5645aaa688c57aa0633c3: Status 404 returned error can't find the container with id 50f4cbce34feb94434f802bb484fb8496807c11813e5645aaa688c57aa0633c3 Jul 09 23:32:46.082854 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:46.082799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" event={"ID":"6f710dc0-07df-42be-88c3-40c9da9e3e37","Type":"ContainerStarted","Data":"50f4cbce34feb94434f802bb484fb8496807c11813e5645aaa688c57aa0633c3"} Jul 09 23:32:49.101813 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:49.101778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" event={"ID":"6f710dc0-07df-42be-88c3-40c9da9e3e37","Type":"ContainerStarted","Data":"8f94f7e4120ca93e1e5742e03136e683328999808139993ff38a44efefe84c3f"} Jul 09 23:32:49.479427 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:49.479401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:32:49.485563 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:49.485535 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:32:49.486666 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:49.486644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:32:49.491236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:49.491216 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 23:32:49.492266 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:49.492243 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:32:50.108215 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:50.108178 2578 generic.go:356] "Generic (PLEG): container finished" podID="6f710dc0-07df-42be-88c3-40c9da9e3e37" containerID="8f94f7e4120ca93e1e5742e03136e683328999808139993ff38a44efefe84c3f" exitCode=0 Jul 09 23:32:50.110772 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:50.108275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" event={"ID":"6f710dc0-07df-42be-88c3-40c9da9e3e37","Type":"ContainerDied","Data":"8f94f7e4120ca93e1e5742e03136e683328999808139993ff38a44efefe84c3f"} Jul 09 23:32:51.115193 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:51.115158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" event={"ID":"6f710dc0-07df-42be-88c3-40c9da9e3e37","Type":"ContainerStarted","Data":"8a73856c0ef4ff36f4a3d8aa0933b1d1893dc92e1f92110228963ae30ecd6708"} Jul 09 23:32:51.115581 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:51.115305 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:32:51.134447 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:51.134405 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" podStartSLOduration=2.602829764 podStartE2EDuration="7.134389793s" totalImagesPullingTime="3.411501505s" totalInitContainerRuntime="1.120058524s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:32:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:32:51.134060307 +0000 UTC m=+302.077973992" watchObservedRunningTime="2026-07-09 23:32:51.134389793 +0000 UTC m=+302.078303494" Jul 09 23:32:54.067687 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:32:54.067660 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c889b46bf-8p89r" Jul 09 23:33:02.122412 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:02.122379 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c55df6879-fnqlv" Jul 09 23:33:12.081921 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.081881 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9"] Jul 09 23:33:12.084974 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.084951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.087289 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.087254 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 23:33:12.087421 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.087253 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c4jvt\"" Jul 09 23:33:12.097945 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.097920 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9"] Jul 09 23:33:12.123610 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.123610 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.123824 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123632 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.123824 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.123824 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.123824 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.123824 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdjf\" (UniqueName: \"kubernetes.io/projected/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-kube-api-access-lkdjf\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.124019 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.124019 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.123868 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224684 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdjf\" (UniqueName: \"kubernetes.io/projected/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-kube-api-access-lkdjf\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.224866 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225179 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225179 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.224999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225307 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.225213 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225355 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.225316 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225355 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.225340 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225421 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.225402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.225618 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.225598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.226964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.226947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.227378 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.227363 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.237671 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.237646 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq"] Jul 09 23:33:12.241496 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.241426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.243674 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.243652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.243789 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.243682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 23:33:12.243789 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.243689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9ctd9\"" Jul 09 23:33:12.243789 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.243683 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 23:33:12.243930 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.243822 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 23:33:12.243930 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.243883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdjf\" (UniqueName: \"kubernetes.io/projected/4a5901f0-12b6-409a-a78b-8ae981d1fc1f-kube-api-access-lkdjf\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678bbsh9\" (UID: \"4a5901f0-12b6-409a-a78b-8ae981d1fc1f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.256012 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.255981 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq"] Jul 09 23:33:12.326054 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.326054 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.326564 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d132a78-c948-492c-85fc-fc55558f0ffa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.326564 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.326564 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.326564 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.326564 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.326272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdkb4\" (UniqueName: \"kubernetes.io/projected/7d132a78-c948-492c-85fc-fc55558f0ffa-kube-api-access-fdkb4\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.395105 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.395018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:12.427555 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.427686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d132a78-c948-492c-85fc-fc55558f0ffa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.427686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.427686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.427686 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.427892 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdkb4\" (UniqueName: \"kubernetes.io/projected/7d132a78-c948-492c-85fc-fc55558f0ffa-kube-api-access-fdkb4\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.427892 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.427738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.428352 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.428317 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.430083 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.430059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.430399 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.430379 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d132a78-c948-492c-85fc-fc55558f0ffa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.430470 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.430415 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.430551 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.430527 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.457137 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.457097 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d132a78-c948-492c-85fc-fc55558f0ffa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.457859 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.457823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdkb4\" (UniqueName: \"kubernetes.io/projected/7d132a78-c948-492c-85fc-fc55558f0ffa-kube-api-access-fdkb4\") pod \"istiod-openshift-gateway-94bb8fbfd-d4lcq\" (UID: \"7d132a78-c948-492c-85fc-fc55558f0ffa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.530873 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.530745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9"] Jul 09 23:33:12.533677 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:33:12.533640 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5901f0_12b6_409a_a78b_8ae981d1fc1f.slice/crio-80d3d6813a2f3c851c296b923656a2c70e7b84e780fe970d872ac5962b3be223 WatchSource:0}: Error finding container 80d3d6813a2f3c851c296b923656a2c70e7b84e780fe970d872ac5962b3be223: Status 404 returned error can't find the container with id 80d3d6813a2f3c851c296b923656a2c70e7b84e780fe970d872ac5962b3be223 Jul 09 23:33:12.535526 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.535507 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 23:33:12.560606 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.560580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:12.708412 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:12.708384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq"] Jul 09 23:33:12.710678 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:33:12.710644 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d132a78_c948_492c_85fc_fc55558f0ffa.slice/crio-fb3503d328e92f206eb60b5560700f126edcbc644dafefa2b6a73a000c506b3a WatchSource:0}: Error finding container fb3503d328e92f206eb60b5560700f126edcbc644dafefa2b6a73a000c506b3a: Status 404 returned error can't find the container with id fb3503d328e92f206eb60b5560700f126edcbc644dafefa2b6a73a000c506b3a Jul 09 23:33:13.216714 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:13.216640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" event={"ID":"7d132a78-c948-492c-85fc-fc55558f0ffa","Type":"ContainerStarted","Data":"fb3503d328e92f206eb60b5560700f126edcbc644dafefa2b6a73a000c506b3a"} Jul 09 23:33:13.218169 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:13.218139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" event={"ID":"4a5901f0-12b6-409a-a78b-8ae981d1fc1f","Type":"ContainerStarted","Data":"80d3d6813a2f3c851c296b923656a2c70e7b84e780fe970d872ac5962b3be223"} Jul 09 23:33:16.139095 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.139057 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:33:16.139559 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.139134 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:33:16.139559 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.139168 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:33:16.139984 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.139953 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:33:16.139984 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.140007 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:33:16.235848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.235816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" event={"ID":"4a5901f0-12b6-409a-a78b-8ae981d1fc1f","Type":"ContainerStarted","Data":"ee131aeafbbdd867bcda6bd9d500169f2d008addf3ac2d472a21aff351ffdb68"} Jul 09 23:33:16.237440 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.237417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" event={"ID":"7d132a78-c948-492c-85fc-fc55558f0ffa","Type":"ContainerStarted","Data":"b4f5139f305cce71dbc9e37ac5de53840c7c78336ed1a54342aa5aec53ecd68c"} Jul 09 23:33:16.237550 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.237534 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:16.272030 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.271963 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" podStartSLOduration=0.668806423 podStartE2EDuration="4.271939541s" totalImagesPullingTime="3.603133118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:33:16.271688419 +0000 UTC m=+327.215602104" watchObservedRunningTime="2026-07-09 23:33:16.271939541 +0000 UTC m=+327.215853224" Jul 09 23:33:16.300138 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.300076 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" podStartSLOduration=0.873028837 podStartE2EDuration="4.300058248s" totalImagesPullingTime="3.427029411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:33:16.298194538 +0000 UTC m=+327.242108220" watchObservedRunningTime="2026-07-09 23:33:16.300058248 +0000 UTC m=+327.243971930" Jul 09 23:33:16.395776 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:16.395666 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:17.243645 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:17.243620 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d4lcq" Jul 09 23:33:17.401047 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:17.401021 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:18.247028 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:18.246990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:33:18.247945 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:33:18.247926 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678bbsh9" Jul 09 23:34:41.533822 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:34:41.533785 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5985f5bd-t2j94"] Jul 09 23:35:06.558165 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.558092 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c5985f5bd-t2j94" podUID="be75834e-f883-42e4-b3d5-2734ca1df2e9" containerName="console" containerID="cri-o://edccbf6ab4634e32d4e361aad5504f90c951c5339c58a196072c6cd124b25fe3" gracePeriod=15 Jul 09 23:35:06.743979 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.743947 2578 generic.go:356] "Generic (PLEG): container finished" podID="be75834e-f883-42e4-b3d5-2734ca1df2e9" containerID="edccbf6ab4634e32d4e361aad5504f90c951c5339c58a196072c6cd124b25fe3" exitCode=0 Jul 09 23:35:06.744152 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.744004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5985f5bd-t2j94" event={"ID":"be75834e-f883-42e4-b3d5-2734ca1df2e9","Type":"ContainerDied","Data":"edccbf6ab4634e32d4e361aad5504f90c951c5339c58a196072c6cd124b25fe3"} Jul 09 23:35:06.801236 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.801206 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:35:06.854615 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854528 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-config\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854615 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854566 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-oauth-config\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854615 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854607 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62vrt\" (UniqueName: \"kubernetes.io/projected/be75834e-f883-42e4-b3d5-2734ca1df2e9-kube-api-access-62vrt\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854660 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-serving-cert\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854694 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-service-ca\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854731 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-oauth-serving-cert\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854822 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-trusted-ca-bundle\") pod \"be75834e-f883-42e4-b3d5-2734ca1df2e9\" (UID: \"be75834e-f883-42e4-b3d5-2734ca1df2e9\") " Jul 09 23:35:06.854890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.854881 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-config" (OuterVolumeSpecName: "console-config") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:35:06.855141 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.855077 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:35:06.855141 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.855123 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:35:06.855234 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.855164 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:06.855234 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.855182 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:06.855367 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.855345 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:35:06.856869 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.856843 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:35:06.856969 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.856868 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 23:35:06.856969 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.856922 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be75834e-f883-42e4-b3d5-2734ca1df2e9-kube-api-access-62vrt" (OuterVolumeSpecName: "kube-api-access-62vrt") pod "be75834e-f883-42e4-b3d5-2734ca1df2e9" (UID: "be75834e-f883-42e4-b3d5-2734ca1df2e9"). InnerVolumeSpecName "kube-api-access-62vrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:35:06.955946 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.955907 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:06.955946 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.955936 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-oauth-serving-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:06.955946 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.955945 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be75834e-f883-42e4-b3d5-2734ca1df2e9-trusted-ca-bundle\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:06.955946 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.955956 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be75834e-f883-42e4-b3d5-2734ca1df2e9-console-oauth-config\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:06.956215 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:06.955964 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62vrt\" (UniqueName: \"kubernetes.io/projected/be75834e-f883-42e4-b3d5-2734ca1df2e9-kube-api-access-62vrt\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:35:07.749368 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:07.749338 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5985f5bd-t2j94" Jul 09 23:35:07.749748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:07.749343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5985f5bd-t2j94" event={"ID":"be75834e-f883-42e4-b3d5-2734ca1df2e9","Type":"ContainerDied","Data":"6fbf951bcd915c5231151ea0eba5a954e1f0c00c91cba11f10ffb33dd5a4fecb"} Jul 09 23:35:07.749748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:07.749469 2578 scope.go:117] "RemoveContainer" containerID="edccbf6ab4634e32d4e361aad5504f90c951c5339c58a196072c6cd124b25fe3" Jul 09 23:35:07.769621 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:07.769596 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5985f5bd-t2j94"] Jul 09 23:35:07.785400 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:07.785374 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c5985f5bd-t2j94"] Jul 09 23:35:09.574551 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:09.574515 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be75834e-f883-42e4-b3d5-2734ca1df2e9" path="/var/lib/kubelet/pods/be75834e-f883-42e4-b3d5-2734ca1df2e9/volumes" Jul 09 23:35:23.639483 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.639406 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8"] Jul 09 23:35:23.639919 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.639901 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be75834e-f883-42e4-b3d5-2734ca1df2e9" containerName="console" Jul 09 23:35:23.639960 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.639923 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be75834e-f883-42e4-b3d5-2734ca1df2e9" containerName="console" Jul 09 23:35:23.640033 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.640022 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be75834e-f883-42e4-b3d5-2734ca1df2e9" containerName="console" Jul 09 23:35:23.643091 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.643072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.645379 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.645357 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hfj5h\"" Jul 09 23:35:23.653590 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.653567 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8"] Jul 09 23:35:23.701511 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.701716 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95p4m\" (UniqueName: \"kubernetes.io/projected/68de50f7-ec80-4781-98ce-82682f4cea75-kube-api-access-95p4m\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.701716 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.701716 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.701882 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.701882 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68de50f7-ec80-4781-98ce-82682f4cea75-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.701882 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.702030 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68de50f7-ec80-4781-98ce-82682f4cea75-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.702030 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.701934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68de50f7-ec80-4781-98ce-82682f4cea75-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803299 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68de50f7-ec80-4781-98ce-82682f4cea75-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68de50f7-ec80-4781-98ce-82682f4cea75-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68de50f7-ec80-4781-98ce-82682f4cea75-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803505 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95p4m\" (UniqueName: \"kubernetes.io/projected/68de50f7-ec80-4781-98ce-82682f4cea75-kube-api-access-95p4m\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803818 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803818 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803818 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803734 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.803818 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803772 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.804004 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.803896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.804071 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.804048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.804144 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.804126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68de50f7-ec80-4781-98ce-82682f4cea75-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.805799 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.805769 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68de50f7-ec80-4781-98ce-82682f4cea75-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.805908 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.805892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68de50f7-ec80-4781-98ce-82682f4cea75-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.811148 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.811117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68de50f7-ec80-4781-98ce-82682f4cea75-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.811556 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.811531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95p4m\" (UniqueName: \"kubernetes.io/projected/68de50f7-ec80-4781-98ce-82682f4cea75-kube-api-access-95p4m\") pod \"maas-default-gateway-openshift-default-5896d4dd49-mtbc8\" (UID: \"68de50f7-ec80-4781-98ce-82682f4cea75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:23.953372 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:23.953347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:24.085598 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.085574 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8"] Jul 09 23:35:24.088390 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:35:24.088358 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68de50f7_ec80_4781_98ce_82682f4cea75.slice/crio-849f6af9ab350fe8b9a335b17c75b27bc46b24e712389cdfb08a3fa7f1deee3a WatchSource:0}: Error finding container 849f6af9ab350fe8b9a335b17c75b27bc46b24e712389cdfb08a3fa7f1deee3a: Status 404 returned error can't find the container with id 849f6af9ab350fe8b9a335b17c75b27bc46b24e712389cdfb08a3fa7f1deee3a Jul 09 23:35:24.090507 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.090474 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:35:24.090599 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.090544 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:35:24.090599 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.090571 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:35:24.833219 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.833183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" event={"ID":"68de50f7-ec80-4781-98ce-82682f4cea75","Type":"ContainerStarted","Data":"90371e4d83bc119c0dd9056a86c622ab16ea20ab2712d6b07217a3bb0d9b613f"} Jul 09 23:35:24.833626 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.833239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" event={"ID":"68de50f7-ec80-4781-98ce-82682f4cea75","Type":"ContainerStarted","Data":"849f6af9ab350fe8b9a335b17c75b27bc46b24e712389cdfb08a3fa7f1deee3a"} Jul 09 23:35:24.852572 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.852524 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" podStartSLOduration=1.852508276 podStartE2EDuration="1.852508276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:35:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:35:24.850173003 +0000 UTC m=+455.794086691" watchObservedRunningTime="2026-07-09 23:35:24.852508276 +0000 UTC m=+455.796421958" Jul 09 23:35:24.953605 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:24.953555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:25.958645 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:25.958616 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:26.843566 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:26.843528 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:35:26.844506 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:35:26.844487 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:36:39.368811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.368776 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zr89x"] Jul 09 23:36:39.371990 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.371973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.374289 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.374260 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kxkxz\"" Jul 09 23:36:39.374358 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.374261 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 23:36:39.378801 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.378778 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zr89x"] Jul 09 23:36:39.483379 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.483347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5tg2\" (UniqueName: \"kubernetes.io/projected/f2390289-734d-47ff-ad0f-8da2f9017198-kube-api-access-j5tg2\") pod \"payload-pre-processing-7964457696-zr89x\" (UID: \"f2390289-734d-47ff-ad0f-8da2f9017198\") " pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.483570 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.483531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2390289-734d-47ff-ad0f-8da2f9017198-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zr89x\" (UID: \"f2390289-734d-47ff-ad0f-8da2f9017198\") " pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.584021 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.583988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5tg2\" (UniqueName: \"kubernetes.io/projected/f2390289-734d-47ff-ad0f-8da2f9017198-kube-api-access-j5tg2\") pod \"payload-pre-processing-7964457696-zr89x\" (UID: \"f2390289-734d-47ff-ad0f-8da2f9017198\") " pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.584207 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.584079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2390289-734d-47ff-ad0f-8da2f9017198-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zr89x\" (UID: \"f2390289-734d-47ff-ad0f-8da2f9017198\") " pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.584743 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.584723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2390289-734d-47ff-ad0f-8da2f9017198-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zr89x\" (UID: \"f2390289-734d-47ff-ad0f-8da2f9017198\") " pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.593259 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.593226 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5tg2\" (UniqueName: \"kubernetes.io/projected/f2390289-734d-47ff-ad0f-8da2f9017198-kube-api-access-j5tg2\") pod \"payload-pre-processing-7964457696-zr89x\" (UID: \"f2390289-734d-47ff-ad0f-8da2f9017198\") " pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.683071 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.683038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:39.818466 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:39.818437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zr89x"] Jul 09 23:36:39.820311 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:36:39.820272 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2390289_734d_47ff_ad0f_8da2f9017198.slice/crio-f31bf48ddbceea25b13766f172f799102b26e25a04d8882528eaa505e2c85c83 WatchSource:0}: Error finding container f31bf48ddbceea25b13766f172f799102b26e25a04d8882528eaa505e2c85c83: Status 404 returned error can't find the container with id f31bf48ddbceea25b13766f172f799102b26e25a04d8882528eaa505e2c85c83 Jul 09 23:36:40.197690 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:40.197649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" event={"ID":"f2390289-734d-47ff-ad0f-8da2f9017198","Type":"ContainerStarted","Data":"f31bf48ddbceea25b13766f172f799102b26e25a04d8882528eaa505e2c85c83"} Jul 09 23:36:42.208484 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:42.208444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" event={"ID":"f2390289-734d-47ff-ad0f-8da2f9017198","Type":"ContainerStarted","Data":"4c3915f43f19d5810a90605f2ef80d8401c85d0bdf1aa0537b0399ab765b1e8d"} Jul 09 23:36:42.208898 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:42.208520 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:36:42.222983 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:42.222934 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" podStartSLOduration=1.797401544 podStartE2EDuration="3.222917383s" totalImagesPullingTime="1.425515839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:36:42.222064892 +0000 UTC m=+533.165978578" watchObservedRunningTime="2026-07-09 23:36:42.222917383 +0000 UTC m=+533.166831065" Jul 09 23:36:47.234581 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:47.234547 2578 generic.go:356] "Generic (PLEG): container finished" podID="68de50f7-ec80-4781-98ce-82682f4cea75" containerID="90371e4d83bc119c0dd9056a86c622ab16ea20ab2712d6b07217a3bb0d9b613f" exitCode=0 Jul 09 23:36:47.234985 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:47.234614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" event={"ID":"68de50f7-ec80-4781-98ce-82682f4cea75","Type":"ContainerDied","Data":"90371e4d83bc119c0dd9056a86c622ab16ea20ab2712d6b07217a3bb0d9b613f"} Jul 09 23:36:47.235026 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:47.235002 2578 scope.go:117] "RemoveContainer" containerID="90371e4d83bc119c0dd9056a86c622ab16ea20ab2712d6b07217a3bb0d9b613f" Jul 09 23:36:47.236044 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:47.236014 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:36:47.236107 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:47.236083 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:36:47.236142 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:47.236115 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:36:48.241819 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:48.241787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" event={"ID":"68de50f7-ec80-4781-98ce-82682f4cea75","Type":"ContainerStarted","Data":"0fcb36b95ad17343829f1d5d944d84c60bf9e3609bcf4ca8ff0a28dd3554410d"} Jul 09 23:36:48.953710 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:48.953675 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:36:48.954008 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:48.953987 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mtbc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 23:36:48.954055 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:48.954035 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" podUID="68de50f7-ec80-4781-98ce-82682f4cea75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 23:36:49.954680 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:49.954644 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mtbc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 23:36:49.955060 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:49.954699 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" podUID="68de50f7-ec80-4781-98ce-82682f4cea75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 23:36:50.954553 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:50.954520 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mtbc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 23:36:50.954738 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:50.954575 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" podUID="68de50f7-ec80-4781-98ce-82682f4cea75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 23:36:51.954665 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:51.954627 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-mtbc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 23:36:51.954855 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:51.954694 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" podUID="68de50f7-ec80-4781-98ce-82682f4cea75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 23:36:52.958163 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:52.958134 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:36:52.958595 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:52.958489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:36:52.959066 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:52.959049 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-mtbc8" Jul 09 23:36:53.215041 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:53.214941 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" podUID="f2390289-734d-47ff-ad0f-8da2f9017198" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.36:9004: connect: connection refused" Jul 09 23:36:57.080753 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.080714 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2"] Jul 09 23:36:57.086404 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.086381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.089410 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.089385 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-28khl\"" Jul 09 23:36:57.089530 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.089411 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 23:36:57.089530 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.089411 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 23:36:57.089530 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.089453 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 23:36:57.095138 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.095117 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2"] Jul 09 23:36:57.159231 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.159196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.159231 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.159234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.159477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.159314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2k6j\" (UniqueName: \"kubernetes.io/projected/20c38e8d-b656-43cd-b5bd-67d91617a5c8-kube-api-access-s2k6j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.159477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.159345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.159477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.159365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20c38e8d-b656-43cd-b5bd-67d91617a5c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.159477 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.159437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.260682 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.260649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.260954 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.260916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261075 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.260999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2k6j\" (UniqueName: \"kubernetes.io/projected/20c38e8d-b656-43cd-b5bd-67d91617a5c8-kube-api-access-s2k6j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261075 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.261038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261075 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.261062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20c38e8d-b656-43cd-b5bd-67d91617a5c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261075 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.261068 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261316 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.261099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.261486 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.261748 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.261707 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.263663 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.263637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20c38e8d-b656-43cd-b5bd-67d91617a5c8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.263934 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.263912 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20c38e8d-b656-43cd-b5bd-67d91617a5c8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.271473 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.271442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2k6j\" (UniqueName: \"kubernetes.io/projected/20c38e8d-b656-43cd-b5bd-67d91617a5c8-kube-api-access-s2k6j\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qfpf2\" (UID: \"20c38e8d-b656-43cd-b5bd-67d91617a5c8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.397342 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.397257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:36:57.531040 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:57.531011 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2"] Jul 09 23:36:57.533425 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:36:57.533399 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c38e8d_b656_43cd_b5bd_67d91617a5c8.slice/crio-daac42f05306865692aa645d985abecee24c51199f42a007ba8049a8992a9b4a WatchSource:0}: Error finding container daac42f05306865692aa645d985abecee24c51199f42a007ba8049a8992a9b4a: Status 404 returned error can't find the container with id daac42f05306865692aa645d985abecee24c51199f42a007ba8049a8992a9b4a Jul 09 23:36:58.291367 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:58.291320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" event={"ID":"20c38e8d-b656-43cd-b5bd-67d91617a5c8","Type":"ContainerStarted","Data":"daac42f05306865692aa645d985abecee24c51199f42a007ba8049a8992a9b4a"} Jul 09 23:36:59.298135 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:59.298093 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" event={"ID":"20c38e8d-b656-43cd-b5bd-67d91617a5c8","Type":"ContainerStarted","Data":"eb36fa0e20f151523855b76b50a69743c2601bac8cee2d03a663550fcdce733e"} Jul 09 23:36:59.313673 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:36:59.313616 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" podStartSLOduration=1.320520235 podStartE2EDuration="2.313600681s" totalImagesPullingTime="993.080446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:36:59.312060211 +0000 UTC m=+550.255973894" watchObservedRunningTime="2026-07-09 23:36:59.313600681 +0000 UTC m=+550.257514365" Jul 09 23:37:03.214048 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:03.214013 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-zr89x" Jul 09 23:37:07.397587 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:07.397546 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:37:07.397994 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:07.397613 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:37:07.410117 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:07.410093 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:37:08.352325 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:08.352273 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qfpf2" Jul 09 23:37:37.688763 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.688722 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz"] Jul 09 23:37:37.695019 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.694995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.697268 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.697249 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 23:37:37.706220 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.706193 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz"] Jul 09 23:37:37.825577 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.825536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkhfb\" (UniqueName: \"kubernetes.io/projected/26567ac6-a9f6-4c27-9678-42506a6fda1f-kube-api-access-qkhfb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.825745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.825594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.825745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.825625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26567ac6-a9f6-4c27-9678-42506a6fda1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.825745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.825671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.825745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.825695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.825745 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.825725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.926958 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.926913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.926958 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.926965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26567ac6-a9f6-4c27-9678-42506a6fda1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927214 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927401 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkhfb\" (UniqueName: \"kubernetes.io/projected/26567ac6-a9f6-4c27-9678-42506a6fda1f-kube-api-access-qkhfb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927491 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927470 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927550 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.927550 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.927517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.929291 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.929249 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26567ac6-a9f6-4c27-9678-42506a6fda1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.929534 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.929518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26567ac6-a9f6-4c27-9678-42506a6fda1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:37.934401 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:37.934374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkhfb\" (UniqueName: \"kubernetes.io/projected/26567ac6-a9f6-4c27-9678-42506a6fda1f-kube-api-access-qkhfb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz\" (UID: \"26567ac6-a9f6-4c27-9678-42506a6fda1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:38.009436 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:38.009350 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:38.139373 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:38.139347 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz"] Jul 09 23:37:38.141913 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:37:38.141873 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26567ac6_a9f6_4c27_9678_42506a6fda1f.slice/crio-c161812261817eb60ce187163137580c662c7de3ea8a297ecf5ac0cb9e81f177 WatchSource:0}: Error finding container c161812261817eb60ce187163137580c662c7de3ea8a297ecf5ac0cb9e81f177: Status 404 returned error can't find the container with id c161812261817eb60ce187163137580c662c7de3ea8a297ecf5ac0cb9e81f177 Jul 09 23:37:38.484645 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:38.484601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" event={"ID":"26567ac6-a9f6-4c27-9678-42506a6fda1f","Type":"ContainerStarted","Data":"fa319ebeb611f6d55e40d1d28bb623cba22ff8ce49121818cae46b8e5cf50ddc"} Jul 09 23:37:38.484811 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:38.484664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" event={"ID":"26567ac6-a9f6-4c27-9678-42506a6fda1f","Type":"ContainerStarted","Data":"c161812261817eb60ce187163137580c662c7de3ea8a297ecf5ac0cb9e81f177"} Jul 09 23:37:38.501073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:38.501020 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" podStartSLOduration=1.328852486 podStartE2EDuration="1.501003342s" totalImagesPullingTime="172.150856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:37:38.498643571 +0000 UTC m=+589.442557254" watchObservedRunningTime="2026-07-09 23:37:38.501003342 +0000 UTC m=+589.444917024" Jul 09 23:37:48.010050 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:48.010004 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:48.010499 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:48.010075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:48.022627 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:48.022600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:48.549124 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:48.549093 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz" Jul 09 23:37:49.513964 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:49.513941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:37:49.518820 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:49.518799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:37:49.522483 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:49.522465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:37:49.527200 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:49.527182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:37:59.183787 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.183745 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv"] Jul 09 23:37:59.187573 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.187549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.189723 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.189698 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 09 23:37:59.195922 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.195902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv"] Jul 09 23:37:59.222010 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.221983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.222118 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.222013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.222118 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.222043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.222202 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.222131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.222202 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.222167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfsdb\" (UniqueName: \"kubernetes.io/projected/db5611ba-abb2-490c-b385-643432474d22-kube-api-access-tfsdb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.222264 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.222241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5611ba-abb2-490c-b385-643432474d22-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.322935 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.322893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.322935 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.322935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323143 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323143 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323209 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfsdb\" (UniqueName: \"kubernetes.io/projected/db5611ba-abb2-490c-b385-643432474d22-kube-api-access-tfsdb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323305 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5611ba-abb2-490c-b385-643432474d22-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323451 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323428 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323520 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.323576 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.323515 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.325246 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.325222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5611ba-abb2-490c-b385-643432474d22-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.325706 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.325684 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5611ba-abb2-490c-b385-643432474d22-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.331634 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.331615 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfsdb\" (UniqueName: \"kubernetes.io/projected/db5611ba-abb2-490c-b385-643432474d22-kube-api-access-tfsdb\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv\" (UID: \"db5611ba-abb2-490c-b385-643432474d22\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.496845 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.496763 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:37:59.632509 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:37:59.632483 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv"] Jul 09 23:37:59.634580 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:37:59.634555 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb5611ba_abb2_490c_b385_643432474d22.slice/crio-5dd8a082d53f35db19195bf7b82804b695eef63dcc58f63aee954450260bae0e WatchSource:0}: Error finding container 5dd8a082d53f35db19195bf7b82804b695eef63dcc58f63aee954450260bae0e: Status 404 returned error can't find the container with id 5dd8a082d53f35db19195bf7b82804b695eef63dcc58f63aee954450260bae0e Jul 09 23:38:00.598764 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:00.598726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" event={"ID":"db5611ba-abb2-490c-b385-643432474d22","Type":"ContainerStarted","Data":"1d99bed1f13e9f24450bafd31403c14fd188abccb112915b3e3b6cc374b23f82"} Jul 09 23:38:00.598764 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:00.598769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" event={"ID":"db5611ba-abb2-490c-b385-643432474d22","Type":"ContainerStarted","Data":"5dd8a082d53f35db19195bf7b82804b695eef63dcc58f63aee954450260bae0e"} Jul 09 23:38:00.615394 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:00.615345 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" podStartSLOduration=1.43410906 podStartE2EDuration="1.615328821s" totalImagesPullingTime="181.219761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:38:00.613005062 +0000 UTC m=+611.556918747" watchObservedRunningTime="2026-07-09 23:38:00.615328821 +0000 UTC m=+611.559242504" Jul 09 23:38:09.497452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:09.497421 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:38:09.497452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:09.497462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:38:09.509965 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:09.509941 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:38:09.656666 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:38:09.656640 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv" Jul 09 23:42:49.545958 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:42:49.545870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:42:49.551232 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:42:49.551206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:42:49.552233 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:42:49.552213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:42:49.557398 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:42:49.557070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:47:49.591481 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:47:49.591447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:47:49.593864 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:47:49.592012 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:47:49.596042 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:47:49.596023 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:47:49.596703 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:47:49.596685 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:52:35.425509 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.425473 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz"] Jul 09 23:52:35.429474 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.429448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.431768 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.431743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-143fdde2-openshift-default-dockercfg-68tv7\"" Jul 09 23:52:35.441773 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.441743 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz"] Jul 09 23:52:35.582665 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-credential-socket\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.582853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-envoy\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.582853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-socket\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.582853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f6d0b72-3c09-434e-b934-248298b3b455-istio-podinfo\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.582853 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-istio-token\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.583073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f6d0b72-3c09-434e-b934-248298b3b455-istiod-ca-cert\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.583073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgtbw\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-kube-api-access-lgtbw\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.583073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.582958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-data\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.583073 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.583006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-certs\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.683956 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.683872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-credential-socket\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.683956 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.683918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-envoy\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.683956 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.683947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-socket\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684206 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.683973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f6d0b72-3c09-434e-b934-248298b3b455-istio-podinfo\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684206 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.683992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-istio-token\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684206 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f6d0b72-3c09-434e-b934-248298b3b455-istiod-ca-cert\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684206 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgtbw\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-kube-api-access-lgtbw\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684444 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-data\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684444 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-certs\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684444 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684345 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-credential-socket\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684444 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-socket\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684711 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-data\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684751 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-certs\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.684812 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.684791 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f6d0b72-3c09-434e-b934-248298b3b455-istiod-ca-cert\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.686438 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.686418 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-envoy\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.686669 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.686650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f6d0b72-3c09-434e-b934-248298b3b455-istio-podinfo\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.691416 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.691390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-istio-token\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.691512 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.691491 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgtbw\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-kube-api-access-lgtbw\") pod \"e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.743528 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.743497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:35.882544 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.882516 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz"] Jul 09 23:52:35.884464 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:52:35.884434 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6d0b72_3c09_434e_b934_248298b3b455.slice/crio-24ae08e5ad44c5e5788301d088dcb2ac3a3e7cc87ba9163f0a1b293e76587a07 WatchSource:0}: Error finding container 24ae08e5ad44c5e5788301d088dcb2ac3a3e7cc87ba9163f0a1b293e76587a07: Status 404 returned error can't find the container with id 24ae08e5ad44c5e5788301d088dcb2ac3a3e7cc87ba9163f0a1b293e76587a07 Jul 09 23:52:35.886606 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.886565 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:52:35.886707 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.886631 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:52:35.886707 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:35.886658 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:52:36.869755 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:36.869719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" event={"ID":"2f6d0b72-3c09-434e-b934-248298b3b455","Type":"ContainerStarted","Data":"1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c"} Jul 09 23:52:36.870136 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:36.869778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" event={"ID":"2f6d0b72-3c09-434e-b934-248298b3b455","Type":"ContainerStarted","Data":"24ae08e5ad44c5e5788301d088dcb2ac3a3e7cc87ba9163f0a1b293e76587a07"} Jul 09 23:52:36.917693 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:36.917644 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" podStartSLOduration=1.917629115 podStartE2EDuration="1.917629115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:52:36.91534202 +0000 UTC m=+1487.859255704" watchObservedRunningTime="2026-07-09 23:52:36.917629115 +0000 UTC m=+1487.861542798" Jul 09 23:52:37.744029 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:37.743991 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:37.748602 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:37.748579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:37.877350 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:37.877318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:37.878254 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:37.878226 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:46.925846 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:46.925813 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f6d0b72-3c09-434e-b934-248298b3b455" containerID="1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c" exitCode=0 Jul 09 23:52:46.926255 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:46.925851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" event={"ID":"2f6d0b72-3c09-434e-b934-248298b3b455","Type":"ContainerDied","Data":"1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c"} Jul 09 23:52:46.926332 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:46.926274 2578 scope.go:117] "RemoveContainer" containerID="1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c" Jul 09 23:52:46.927269 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:46.927238 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:52:46.927358 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:46.927327 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:52:46.927397 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:46.927359 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 23:52:47.725761 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:47.725722 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz"] Jul 09 23:52:47.932970 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:47.932936 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" event={"ID":"2f6d0b72-3c09-434e-b934-248298b3b455","Type":"ContainerStarted","Data":"286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e"} Jul 09 23:52:47.933452 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:47.932983 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" containerID="cri-o://286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e" gracePeriod=30 Jul 09 23:52:49.623067 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:49.623036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:52:49.623523 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:49.623120 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:52:49.627664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:49.627637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:52:49.628146 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:49.628131 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:52:52.877789 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:52.877752 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:53.191593 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.191567 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:53.260991 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.260962 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f6d0b72-3c09-434e-b934-248298b3b455-istiod-ca-cert\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261182 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.260998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-socket\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261182 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261041 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-data\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261182 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261098 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-certs\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261182 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261139 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-istio-token\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261227 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-credential-socket\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261268 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgtbw\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-kube-api-access-lgtbw\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261325 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f6d0b72-3c09-434e-b934-248298b3b455-istio-podinfo\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261350 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-envoy\") pod \"2f6d0b72-3c09-434e-b934-248298b3b455\" (UID: \"2f6d0b72-3c09-434e-b934-248298b3b455\") " Jul 09 23:52:53.261409 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261375 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:52:53.261664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261516 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:52:53.261664 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261547 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6d0b72-3c09-434e-b934-248298b3b455-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 23:52:53.261777 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261722 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-credential-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.261777 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261740 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f6d0b72-3c09-434e-b934-248298b3b455-istiod-ca-cert\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.261777 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261752 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-socket\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.261777 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261755 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:52:53.261977 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.261935 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:52:53.263559 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.263533 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f6d0b72-3c09-434e-b934-248298b3b455-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 23:52:53.263678 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.263551 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-kube-api-access-lgtbw" (OuterVolumeSpecName: "kube-api-access-lgtbw") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "kube-api-access-lgtbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:52:53.263740 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.263730 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 23:52:53.263799 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.263785 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f6d0b72-3c09-434e-b934-248298b3b455" (UID: "2f6d0b72-3c09-434e-b934-248298b3b455"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 23:52:53.362895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.362860 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-data\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.362895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.362890 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-workload-certs\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.362895 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.362899 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-istio-token\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.363121 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.362909 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgtbw\" (UniqueName: \"kubernetes.io/projected/2f6d0b72-3c09-434e-b934-248298b3b455-kube-api-access-lgtbw\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.363121 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.362917 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f6d0b72-3c09-434e-b934-248298b3b455-istio-podinfo\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.363121 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.362925 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f6d0b72-3c09-434e-b934-248298b3b455-istio-envoy\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 09 23:52:53.966490 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.966455 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f6d0b72-3c09-434e-b934-248298b3b455" containerID="286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e" exitCode=0 Jul 09 23:52:53.966982 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.966502 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" Jul 09 23:52:53.966982 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.966528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" event={"ID":"2f6d0b72-3c09-434e-b934-248298b3b455","Type":"ContainerDied","Data":"286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e"} Jul 09 23:52:53.966982 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.966587 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz" event={"ID":"2f6d0b72-3c09-434e-b934-248298b3b455","Type":"ContainerDied","Data":"24ae08e5ad44c5e5788301d088dcb2ac3a3e7cc87ba9163f0a1b293e76587a07"} Jul 09 23:52:53.966982 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.966618 2578 scope.go:117] "RemoveContainer" containerID="286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e" Jul 09 23:52:53.975610 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.975589 2578 scope.go:117] "RemoveContainer" containerID="1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c" Jul 09 23:52:53.983342 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.983319 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz"] Jul 09 23:52:53.984662 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.984595 2578 scope.go:117] "RemoveContainer" containerID="286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e" Jul 09 23:52:53.984958 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:52:53.984933 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e\": container with ID starting with 286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e not found: ID does not exist" containerID="286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e" Jul 09 23:52:53.985058 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.984965 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e"} err="failed to get container status \"286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e\": rpc error: code = NotFound desc = could not find container \"286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e\": container with ID starting with 286ce8b62e905346e06afe00fcfb0747f018ef920816266d602e88fafd5eca2e not found: ID does not exist" Jul 09 23:52:53.985058 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.984986 2578 scope.go:117] "RemoveContainer" containerID="1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c" Jul 09 23:52:53.985259 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:52:53.985238 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c\": container with ID starting with 1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c not found: ID does not exist" containerID="1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c" Jul 09 23:52:53.985363 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.985268 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c"} err="failed to get container status \"1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c\": rpc error: code = NotFound desc = could not find container \"1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c\": container with ID starting with 1078e280a8ba6606c90adf366036717cd6378443385f183e72ea8d663a81b91c not found: ID does not exist" Jul 09 23:52:53.986671 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:53.986648 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-143fdde2-openshift-default-87b494c8f-bmzbz"] Jul 09 23:52:55.575127 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:52:55.575092 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" path="/var/lib/kubelet/pods/2f6d0b72-3c09-434e-b934-248298b3b455/volumes" Jul 09 23:57:49.653408 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:57:49.653378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:57:49.654496 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:57:49.654475 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 09 23:57:49.658179 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:57:49.658156 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:57:49.659179 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:57:49.659156 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 09 23:58:50.840226 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840190 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74"] Jul 09 23:58:50.840772 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840746 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" Jul 09 23:58:50.840772 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840764 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" Jul 09 23:58:50.840848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840779 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" Jul 09 23:58:50.840848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840785 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" Jul 09 23:58:50.840848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840839 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" Jul 09 23:58:50.840848 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.840848 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6d0b72-3c09-434e-b934-248298b3b455" containerName="istio-proxy" Jul 09 23:58:50.843898 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.843881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.845996 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.845971 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fvtlc\"" Jul 09 23:58:50.846296 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.846251 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 23:58:50.846890 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.846869 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 23:58:50.846985 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.846960 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4f4769-serving-cert\"" Jul 09 23:58:50.854385 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.854362 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74"] Jul 09 23:58:50.896987 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.896951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.896987 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.896999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.897213 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.897117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncj2q\" (UniqueName: \"kubernetes.io/projected/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-kube-api-access-ncj2q\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.997665 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.997622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncj2q\" (UniqueName: \"kubernetes.io/projected/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-kube-api-access-ncj2q\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.997841 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.997703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.997841 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.997731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:50.997932 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:58:50.997865 2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-serving-cert: secret "maas-api-e2e-inf-b-4f4769-serving-cert" not found Jul 09 23:58:50.997967 ip-10-0-132-128 kubenswrapper[2578]: E0709 23:58:50.997944 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls podName:11cfe884-1fb2-4d3c-b5d5-f5ba65322994 nodeName:}" failed. No retries permitted until 2026-07-09 23:58:51.497922853 +0000 UTC m=+1862.441836514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls") pod "maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" (UID: "11cfe884-1fb2-4d3c-b5d5-f5ba65322994") : secret "maas-api-e2e-inf-b-4f4769-serving-cert" not found Jul 09 23:58:50.998484 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:50.998467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:51.008397 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:51.008365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncj2q\" (UniqueName: \"kubernetes.io/projected/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-kube-api-access-ncj2q\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:51.503958 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:51.503922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:51.506427 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:51.506410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls\") pod \"maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:51.756770 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:51.756675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:51.896488 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:51.896463 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74"] Jul 09 23:58:51.899238 ip-10-0-132-128 kubenswrapper[2578]: W0709 23:58:51.899206 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cfe884_1fb2_4d3c_b5d5_f5ba65322994.slice/crio-4b0c6de104583229d034080a71a65e8cd14b576daa9f26198100fb6bd974a3ed WatchSource:0}: Error finding container 4b0c6de104583229d034080a71a65e8cd14b576daa9f26198100fb6bd974a3ed: Status 404 returned error can't find the container with id 4b0c6de104583229d034080a71a65e8cd14b576daa9f26198100fb6bd974a3ed Jul 09 23:58:51.900765 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:51.900743 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 23:58:52.727037 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:52.726996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" event={"ID":"11cfe884-1fb2-4d3c-b5d5-f5ba65322994","Type":"ContainerStarted","Data":"4b0c6de104583229d034080a71a65e8cd14b576daa9f26198100fb6bd974a3ed"} Jul 09 23:58:53.733102 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:53.733003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" event={"ID":"11cfe884-1fb2-4d3c-b5d5-f5ba65322994","Type":"ContainerStarted","Data":"941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a"} Jul 09 23:58:53.733522 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:53.733146 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:58:53.749426 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:53.749375 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" podStartSLOduration=2.201124706 podStartE2EDuration="3.749358875s" totalImagesPullingTime="1.548234169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:58:53.747130619 +0000 UTC m=+1864.691044303" watchObservedRunningTime="2026-07-09 23:58:53.749358875 +0000 UTC m=+1864.693272558" Jul 09 23:58:59.740093 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:58:59.740051 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.41:8443/health\": dial tcp 10.132.0.41:8443: connect: connection refused" Jul 09 23:59:03.791242 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:59:03.791204 2578 generic.go:356] "Generic (PLEG): container finished" podID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerID="941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a" exitCode=1 Jul 09 23:59:03.791641 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:59:03.791259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" event={"ID":"11cfe884-1fb2-4d3c-b5d5-f5ba65322994","Type":"ContainerDied","Data":"941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a"} Jul 09 23:59:03.791687 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:59:03.791639 2578 scope.go:117] "RemoveContainer" containerID="941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a" Jul 09 23:59:04.797667 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:59:04.797633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" event={"ID":"11cfe884-1fb2-4d3c-b5d5-f5ba65322994","Type":"ContainerStarted","Data":"9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d"} Jul 09 23:59:04.798078 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:59:04.797840 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 09 23:59:10.808685 ip-10-0-132-128 kubenswrapper[2578]: I0709 23:59:10.808657 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 10 00:00:00.155196 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.155159 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29727360-7vltd"] Jul 10 00:00:00.159364 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.159340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.162730 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.162707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\"" Jul 10 00:00:00.162865 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.162842 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-shdjd\"" Jul 10 00:00:00.171777 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.171752 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29727360-7vltd"] Jul 10 00:00:00.262539 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.262508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdd9n\" (UniqueName: \"kubernetes.io/projected/f212a5c4-8906-4c23-9f82-7bb205c06d8c-kube-api-access-tdd9n\") pod \"image-pruner-29727360-7vltd\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.262931 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.262583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f212a5c4-8906-4c23-9f82-7bb205c06d8c-serviceca\") pod \"image-pruner-29727360-7vltd\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.363350 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.363314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f212a5c4-8906-4c23-9f82-7bb205c06d8c-serviceca\") pod \"image-pruner-29727360-7vltd\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.363514 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.363409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdd9n\" (UniqueName: \"kubernetes.io/projected/f212a5c4-8906-4c23-9f82-7bb205c06d8c-kube-api-access-tdd9n\") pod \"image-pruner-29727360-7vltd\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.364187 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.364163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f212a5c4-8906-4c23-9f82-7bb205c06d8c-serviceca\") pod \"image-pruner-29727360-7vltd\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.371298 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.371256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdd9n\" (UniqueName: \"kubernetes.io/projected/f212a5c4-8906-4c23-9f82-7bb205c06d8c-kube-api-access-tdd9n\") pod \"image-pruner-29727360-7vltd\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.491799 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.491764 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:00.635393 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:00.635369 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29727360-7vltd"] Jul 10 00:00:00.637850 ip-10-0-132-128 kubenswrapper[2578]: W0710 00:00:00.637826 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf212a5c4_8906_4c23_9f82_7bb205c06d8c.slice/crio-64cc10034e6ef9c3dcd01643e630e454e7fe7f7f284ae1de65911e61ba602655 WatchSource:0}: Error finding container 64cc10034e6ef9c3dcd01643e630e454e7fe7f7f284ae1de65911e61ba602655: Status 404 returned error can't find the container with id 64cc10034e6ef9c3dcd01643e630e454e7fe7f7f284ae1de65911e61ba602655 Jul 10 00:00:01.087446 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:01.087414 2578 generic.go:356] "Generic (PLEG): container finished" podID="f212a5c4-8906-4c23-9f82-7bb205c06d8c" containerID="d16b2d8721e276f1c8e0071b234d7ab6b1cad940dbd989eba011d8ade734e760" exitCode=0 Jul 10 00:00:01.087627 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:01.087496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29727360-7vltd" event={"ID":"f212a5c4-8906-4c23-9f82-7bb205c06d8c","Type":"ContainerDied","Data":"d16b2d8721e276f1c8e0071b234d7ab6b1cad940dbd989eba011d8ade734e760"} Jul 10 00:00:01.087627 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:01.087558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29727360-7vltd" event={"ID":"f212a5c4-8906-4c23-9f82-7bb205c06d8c","Type":"ContainerStarted","Data":"64cc10034e6ef9c3dcd01643e630e454e7fe7f7f284ae1de65911e61ba602655"} Jul 10 00:00:02.226596 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.226573 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:02.280897 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.280864 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdd9n\" (UniqueName: \"kubernetes.io/projected/f212a5c4-8906-4c23-9f82-7bb205c06d8c-kube-api-access-tdd9n\") pod \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " Jul 10 00:00:02.281062 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.280970 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f212a5c4-8906-4c23-9f82-7bb205c06d8c-serviceca\") pod \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\" (UID: \"f212a5c4-8906-4c23-9f82-7bb205c06d8c\") " Jul 10 00:00:02.281382 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.281360 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f212a5c4-8906-4c23-9f82-7bb205c06d8c-serviceca" (OuterVolumeSpecName: "serviceca") pod "f212a5c4-8906-4c23-9f82-7bb205c06d8c" (UID: "f212a5c4-8906-4c23-9f82-7bb205c06d8c"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 00:00:02.283077 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.283057 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f212a5c4-8906-4c23-9f82-7bb205c06d8c-kube-api-access-tdd9n" (OuterVolumeSpecName: "kube-api-access-tdd9n") pod "f212a5c4-8906-4c23-9f82-7bb205c06d8c" (UID: "f212a5c4-8906-4c23-9f82-7bb205c06d8c"). InnerVolumeSpecName "kube-api-access-tdd9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 00:00:02.382632 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.382539 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdd9n\" (UniqueName: \"kubernetes.io/projected/f212a5c4-8906-4c23-9f82-7bb205c06d8c-kube-api-access-tdd9n\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:00:02.382632 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:02.382573 2578 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f212a5c4-8906-4c23-9f82-7bb205c06d8c-serviceca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:00:03.098501 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:03.098470 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29727360-7vltd" Jul 10 00:00:03.098501 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:03.098489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29727360-7vltd" event={"ID":"f212a5c4-8906-4c23-9f82-7bb205c06d8c","Type":"ContainerDied","Data":"64cc10034e6ef9c3dcd01643e630e454e7fe7f7f284ae1de65911e61ba602655"} Jul 10 00:00:03.098716 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:03.098529 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64cc10034e6ef9c3dcd01643e630e454e7fe7f7f284ae1de65911e61ba602655" Jul 10 00:00:58.828267 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:58.828185 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74"] Jul 10 00:00:58.828764 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:58.828425 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" containerID="cri-o://9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d" gracePeriod=30 Jul 10 00:00:59.074886 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.074860 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 10 00:00:59.216195 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.216141 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls\") pod \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " Jul 10 00:00:59.216420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.216223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-openshift-service-ca\") pod \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " Jul 10 00:00:59.216420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.216349 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncj2q\" (UniqueName: \"kubernetes.io/projected/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-kube-api-access-ncj2q\") pod \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\" (UID: \"11cfe884-1fb2-4d3c-b5d5-f5ba65322994\") " Jul 10 00:00:59.216607 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.216571 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11cfe884-1fb2-4d3c-b5d5-f5ba65322994" (UID: "11cfe884-1fb2-4d3c-b5d5-f5ba65322994"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 00:00:59.216681 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.216657 2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-openshift-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:00:59.218494 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.218472 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11cfe884-1fb2-4d3c-b5d5-f5ba65322994" (UID: "11cfe884-1fb2-4d3c-b5d5-f5ba65322994"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 00:00:59.218549 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.218510 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-kube-api-access-ncj2q" (OuterVolumeSpecName: "kube-api-access-ncj2q") pod "11cfe884-1fb2-4d3c-b5d5-f5ba65322994" (UID: "11cfe884-1fb2-4d3c-b5d5-f5ba65322994"). InnerVolumeSpecName "kube-api-access-ncj2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 00:00:59.317344 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.317293 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncj2q\" (UniqueName: \"kubernetes.io/projected/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-kube-api-access-ncj2q\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:00:59.317344 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.317338 2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11cfe884-1fb2-4d3c-b5d5-f5ba65322994-maas-api-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:00:59.387358 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.387322 2578 generic.go:356] "Generic (PLEG): container finished" podID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerID="9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d" exitCode=0 Jul 10 00:00:59.387544 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.387373 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" Jul 10 00:00:59.387544 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.387398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" event={"ID":"11cfe884-1fb2-4d3c-b5d5-f5ba65322994","Type":"ContainerDied","Data":"9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d"} Jul 10 00:00:59.387544 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.387446 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74" event={"ID":"11cfe884-1fb2-4d3c-b5d5-f5ba65322994","Type":"ContainerDied","Data":"4b0c6de104583229d034080a71a65e8cd14b576daa9f26198100fb6bd974a3ed"} Jul 10 00:00:59.387544 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.387468 2578 scope.go:117] "RemoveContainer" containerID="9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d" Jul 10 00:00:59.396867 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.396848 2578 scope.go:117] "RemoveContainer" containerID="941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a" Jul 10 00:00:59.405105 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.405087 2578 scope.go:117] "RemoveContainer" containerID="9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d" Jul 10 00:00:59.405379 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:00:59.405361 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d\": container with ID starting with 9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d not found: ID does not exist" containerID="9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d" Jul 10 00:00:59.405468 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.405393 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d"} err="failed to get container status \"9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d\": rpc error: code = NotFound desc = could not find container \"9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d\": container with ID starting with 9887fd339e03b207510d3aac0c77624ed23f8ddc28664d6fcca4b839c392298d not found: ID does not exist" Jul 10 00:00:59.405468 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.405417 2578 scope.go:117] "RemoveContainer" containerID="941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a" Jul 10 00:00:59.405649 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:00:59.405631 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a\": container with ID starting with 941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a not found: ID does not exist" containerID="941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a" Jul 10 00:00:59.405688 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.405656 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a"} err="failed to get container status \"941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a\": rpc error: code = NotFound desc = could not find container \"941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a\": container with ID starting with 941905f1e49f8c66a9a3a6f82f7858a8ffe0fc03a471a9f966128e4cbefa4e1a not found: ID does not exist" Jul 10 00:00:59.410802 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.410781 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74"] Jul 10 00:00:59.413620 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.413602 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4f4769-9c97bdc66-xch74"] Jul 10 00:00:59.580661 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:00:59.580582 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" path="/var/lib/kubelet/pods/11cfe884-1fb2-4d3c-b5d5-f5ba65322994/volumes" Jul 10 00:01:08.585126 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585085 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt"] Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585479 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585490 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585501 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585506 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585527 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f212a5c4-8906-4c23-9f82-7bb205c06d8c" containerName="image-pruner" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585534 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f212a5c4-8906-4c23-9f82-7bb205c06d8c" containerName="image-pruner" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585596 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585606 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f212a5c4-8906-4c23-9f82-7bb205c06d8c" containerName="image-pruner" Jul 10 00:01:08.585653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.585615 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="11cfe884-1fb2-4d3c-b5d5-f5ba65322994" containerName="maas-api" Jul 10 00:01:08.590231 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.590212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.592695 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.592673 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-04eddb-serving-cert\"" Jul 10 00:01:08.592780 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.592700 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 00:01:08.593436 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.593421 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fvtlc\"" Jul 10 00:01:08.593495 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.593425 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 00:01:08.598390 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.597916 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt"] Jul 10 00:01:08.701252 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.701212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-openshift-service-ca\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.701475 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.701270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7rf7\" (UniqueName: \"kubernetes.io/projected/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-kube-api-access-f7rf7\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.701475 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.701360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-maas-api-tls\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.802633 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.802595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-openshift-service-ca\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.802843 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.802650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7rf7\" (UniqueName: \"kubernetes.io/projected/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-kube-api-access-f7rf7\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.802843 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.802682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-maas-api-tls\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.803362 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.803338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-openshift-service-ca\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.805290 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.805259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-maas-api-tls\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.811673 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.811648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7rf7\" (UniqueName: \"kubernetes.io/projected/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-kube-api-access-f7rf7\") pod \"maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:08.903771 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:08.903675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:09.042095 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:09.042074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt"] Jul 10 00:01:09.044329 ip-10-0-132-128 kubenswrapper[2578]: W0710 00:01:09.044305 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb82b60_4cdb_4ce3_a88e_6a17a2fc1641.slice/crio-8d80e07bbbedaad463e3170377fd515fa806000648aa6f456d42e57888c48285 WatchSource:0}: Error finding container 8d80e07bbbedaad463e3170377fd515fa806000648aa6f456d42e57888c48285: Status 404 returned error can't find the container with id 8d80e07bbbedaad463e3170377fd515fa806000648aa6f456d42e57888c48285 Jul 10 00:01:09.443140 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:09.443111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" event={"ID":"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641","Type":"ContainerStarted","Data":"8d80e07bbbedaad463e3170377fd515fa806000648aa6f456d42e57888c48285"} Jul 10 00:01:10.450679 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:10.450646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" event={"ID":"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641","Type":"ContainerStarted","Data":"1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70"} Jul 10 00:01:10.451113 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:10.450783 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:10.465714 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:10.465621 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" podStartSLOduration=2.060326744 podStartE2EDuration="2.465603025s" totalImagesPullingTime="405.276281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:01:10.465090504 +0000 UTC m=+2001.409004188" watchObservedRunningTime="2026-07-10 00:01:10.465603025 +0000 UTC m=+2001.409516708" Jul 10 00:01:16.461582 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.461552 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:16.647222 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.647182 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th"] Jul 10 00:01:16.651713 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.651696 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.654113 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.654083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9ed59f-serving-cert\"" Jul 10 00:01:16.661866 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.661838 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th"] Jul 10 00:01:16.685434 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.685400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.685618 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.685486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.685618 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.685543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg6ws\" (UniqueName: \"kubernetes.io/projected/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-kube-api-access-cg6ws\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.786751 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.786660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.786751 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.786747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.786944 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.786772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg6ws\" (UniqueName: \"kubernetes.io/projected/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-kube-api-access-cg6ws\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.786944 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:01:16.786898 2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-serving-cert: secret "maas-api-e2e-api-b-9ed59f-serving-cert" not found Jul 10 00:01:16.787033 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:01:16.786977 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls podName:fa06dca1-4d61-4cb8-81af-a1e023fb09d2 nodeName:}" failed. No retries permitted until 2026-07-10 00:01:17.286957593 +0000 UTC m=+2008.230871258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls") pod "maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" (UID: "fa06dca1-4d61-4cb8-81af-a1e023fb09d2") : secret "maas-api-e2e-api-b-9ed59f-serving-cert" not found Jul 10 00:01:16.787350 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.787333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:16.794656 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:16.794626 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg6ws\" (UniqueName: \"kubernetes.io/projected/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-kube-api-access-cg6ws\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:17.292089 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:17.292051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:17.294577 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:17.294556 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:17.566815 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:17.566708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:17.703801 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:17.703775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th"] Jul 10 00:01:17.706640 ip-10-0-132-128 kubenswrapper[2578]: W0710 00:01:17.706612 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa06dca1_4d61_4cb8_81af_a1e023fb09d2.slice/crio-ad2121b1ae5c92ac4470f59321b89b051927e9dba52bbb053a009360b4f40b8f WatchSource:0}: Error finding container ad2121b1ae5c92ac4470f59321b89b051927e9dba52bbb053a009360b4f40b8f: Status 404 returned error can't find the container with id ad2121b1ae5c92ac4470f59321b89b051927e9dba52bbb053a009360b4f40b8f Jul 10 00:01:18.491998 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:18.491966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" event={"ID":"fa06dca1-4d61-4cb8-81af-a1e023fb09d2","Type":"ContainerStarted","Data":"ad2121b1ae5c92ac4470f59321b89b051927e9dba52bbb053a009360b4f40b8f"} Jul 10 00:01:19.498379 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:19.498340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" event={"ID":"fa06dca1-4d61-4cb8-81af-a1e023fb09d2","Type":"ContainerStarted","Data":"148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c"} Jul 10 00:01:19.498858 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:19.498457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:19.515475 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:19.515420 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" podStartSLOduration=2.802670688 podStartE2EDuration="3.515405017s" totalImagesPullingTime="712.734329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:01:19.512212619 +0000 UTC m=+2010.456126302" watchObservedRunningTime="2026-07-10 00:01:19.515405017 +0000 UTC m=+2010.459318699" Jul 10 00:01:25.508556 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:25.508524 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:29.864751 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:29.864715 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt"] Jul 10 00:01:29.865153 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:29.864907 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" podUID="1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" containerName="maas-api" containerID="cri-o://1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70" gracePeriod=30 Jul 10 00:01:30.121482 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.121415 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:30.218891 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.218859 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7rf7\" (UniqueName: \"kubernetes.io/projected/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-kube-api-access-f7rf7\") pod \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " Jul 10 00:01:30.219062 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.218910 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-maas-api-tls\") pod \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " Jul 10 00:01:30.219062 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.219017 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-openshift-service-ca\") pod \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\" (UID: \"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641\") " Jul 10 00:01:30.219445 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.219407 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" (UID: "1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 00:01:30.220963 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.220926 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-kube-api-access-f7rf7" (OuterVolumeSpecName: "kube-api-access-f7rf7") pod "1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" (UID: "1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641"). InnerVolumeSpecName "kube-api-access-f7rf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 00:01:30.221077 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.221025 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" (UID: "1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 00:01:30.320597 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.320565 2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-openshift-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:01:30.320597 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.320594 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7rf7\" (UniqueName: \"kubernetes.io/projected/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-kube-api-access-f7rf7\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:01:30.320597 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.320605 2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641-maas-api-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:01:30.554611 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.554572 2578 generic.go:356] "Generic (PLEG): container finished" podID="1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" containerID="1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70" exitCode=0 Jul 10 00:01:30.554762 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.554623 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" Jul 10 00:01:30.554762 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.554654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" event={"ID":"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641","Type":"ContainerDied","Data":"1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70"} Jul 10 00:01:30.554762 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.554723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt" event={"ID":"1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641","Type":"ContainerDied","Data":"8d80e07bbbedaad463e3170377fd515fa806000648aa6f456d42e57888c48285"} Jul 10 00:01:30.554762 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.554745 2578 scope.go:117] "RemoveContainer" containerID="1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70" Jul 10 00:01:30.564569 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.564541 2578 scope.go:117] "RemoveContainer" containerID="1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70" Jul 10 00:01:30.564824 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:01:30.564805 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70\": container with ID starting with 1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70 not found: ID does not exist" containerID="1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70" Jul 10 00:01:30.564876 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.564833 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70"} err="failed to get container status \"1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70\": rpc error: code = NotFound desc = could not find container \"1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70\": container with ID starting with 1f92124a88c18e7cea6e0b9aa18203059d0a4f20a4545dfb642b9842e68f1d70 not found: ID does not exist" Jul 10 00:01:30.575497 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.575466 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt"] Jul 10 00:01:30.577736 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:30.577711 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-04eddb-66fb7f8d75-tsnkt"] Jul 10 00:01:31.574746 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:31.574711 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" path="/var/lib/kubelet/pods/1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641/volumes" Jul 10 00:01:36.796678 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:36.796643 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th"] Jul 10 00:01:36.797166 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:36.796884 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" podUID="fa06dca1-4d61-4cb8-81af-a1e023fb09d2" containerName="maas-api" containerID="cri-o://148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c" gracePeriod=30 Jul 10 00:01:37.043314 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.043274 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:37.191498 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.191464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-openshift-service-ca\") pod \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " Jul 10 00:01:37.191725 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.191514 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg6ws\" (UniqueName: \"kubernetes.io/projected/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-kube-api-access-cg6ws\") pod \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " Jul 10 00:01:37.191725 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.191586 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls\") pod \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\" (UID: \"fa06dca1-4d61-4cb8-81af-a1e023fb09d2\") " Jul 10 00:01:37.191850 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.191824 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa06dca1-4d61-4cb8-81af-a1e023fb09d2" (UID: "fa06dca1-4d61-4cb8-81af-a1e023fb09d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 00:01:37.191961 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.191946 2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-openshift-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:01:37.193660 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.193632 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa06dca1-4d61-4cb8-81af-a1e023fb09d2" (UID: "fa06dca1-4d61-4cb8-81af-a1e023fb09d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 00:01:37.193660 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.193645 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-kube-api-access-cg6ws" (OuterVolumeSpecName: "kube-api-access-cg6ws") pod "fa06dca1-4d61-4cb8-81af-a1e023fb09d2" (UID: "fa06dca1-4d61-4cb8-81af-a1e023fb09d2"). InnerVolumeSpecName "kube-api-access-cg6ws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 00:01:37.292609 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.292575 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg6ws\" (UniqueName: \"kubernetes.io/projected/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-kube-api-access-cg6ws\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:01:37.292609 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.292602 2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa06dca1-4d61-4cb8-81af-a1e023fb09d2-maas-api-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:01:37.592111 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.592083 2578 generic.go:356] "Generic (PLEG): container finished" podID="fa06dca1-4d61-4cb8-81af-a1e023fb09d2" containerID="148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c" exitCode=0 Jul 10 00:01:37.592260 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.592122 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" Jul 10 00:01:37.592260 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.592162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" event={"ID":"fa06dca1-4d61-4cb8-81af-a1e023fb09d2","Type":"ContainerDied","Data":"148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c"} Jul 10 00:01:37.592260 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.592212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th" event={"ID":"fa06dca1-4d61-4cb8-81af-a1e023fb09d2","Type":"ContainerDied","Data":"ad2121b1ae5c92ac4470f59321b89b051927e9dba52bbb053a009360b4f40b8f"} Jul 10 00:01:37.592260 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.592237 2578 scope.go:117] "RemoveContainer" containerID="148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c" Jul 10 00:01:37.601503 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.601486 2578 scope.go:117] "RemoveContainer" containerID="148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c" Jul 10 00:01:37.601774 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:01:37.601753 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c\": container with ID starting with 148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c not found: ID does not exist" containerID="148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c" Jul 10 00:01:37.601832 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.601787 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c"} err="failed to get container status \"148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c\": rpc error: code = NotFound desc = could not find container \"148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c\": container with ID starting with 148c402bdc07ffe2b55793f180095ebbd0a03a523c7118b7dcb35e864fbdac4c not found: ID does not exist" Jul 10 00:01:37.608471 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.608448 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th"] Jul 10 00:01:37.610336 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:37.610317 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9ed59f-6cf87b4877-vm7th"] Jul 10 00:01:39.575387 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:39.575356 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa06dca1-4d61-4cb8-81af-a1e023fb09d2" path="/var/lib/kubelet/pods/fa06dca1-4d61-4cb8-81af-a1e023fb09d2/volumes" Jul 10 00:01:45.847545 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.847508 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f"] Jul 10 00:01:45.847931 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.847911 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" containerName="maas-api" Jul 10 00:01:45.847931 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.847924 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" containerName="maas-api" Jul 10 00:01:45.848000 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.847942 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa06dca1-4d61-4cb8-81af-a1e023fb09d2" containerName="maas-api" Jul 10 00:01:45.848000 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.847947 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa06dca1-4d61-4cb8-81af-a1e023fb09d2" containerName="maas-api" Jul 10 00:01:45.848066 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.848002 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa06dca1-4d61-4cb8-81af-a1e023fb09d2" containerName="maas-api" Jul 10 00:01:45.848066 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.848012 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb82b60-4cdb-4ce3-a88e-6a17a2fc1641" containerName="maas-api" Jul 10 00:01:45.852099 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.852079 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:45.855990 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.855966 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-4c394e-serving-cert\"" Jul 10 00:01:45.856673 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.856649 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fvtlc\"" Jul 10 00:01:45.857472 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.857455 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 00:01:45.860697 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.860678 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 00:01:45.873449 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.873422 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f"] Jul 10 00:01:45.971704 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.971669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tchg7\" (UniqueName: \"kubernetes.io/projected/4d757cb6-a873-49a2-b62d-912bbb8938ef-kube-api-access-tchg7\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:45.971881 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.971731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d757cb6-a873-49a2-b62d-912bbb8938ef-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:45.971881 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:45.971855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d757cb6-a873-49a2-b62d-912bbb8938ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.072476 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.072438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tchg7\" (UniqueName: \"kubernetes.io/projected/4d757cb6-a873-49a2-b62d-912bbb8938ef-kube-api-access-tchg7\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.072631 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.072492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d757cb6-a873-49a2-b62d-912bbb8938ef-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.072631 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.072549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d757cb6-a873-49a2-b62d-912bbb8938ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.073149 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.073124 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d757cb6-a873-49a2-b62d-912bbb8938ef-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.075002 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.074980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d757cb6-a873-49a2-b62d-912bbb8938ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.080635 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.080615 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tchg7\" (UniqueName: \"kubernetes.io/projected/4d757cb6-a873-49a2-b62d-912bbb8938ef-kube-api-access-tchg7\") pod \"maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.162241 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.162151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:46.299532 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.299460 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f"] Jul 10 00:01:46.301921 ip-10-0-132-128 kubenswrapper[2578]: W0710 00:01:46.301893 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d757cb6_a873_49a2_b62d_912bbb8938ef.slice/crio-85a94f730a61b185f201cb39df6a5a73bbcb9c33035821ba0997e8544be696b9 WatchSource:0}: Error finding container 85a94f730a61b185f201cb39df6a5a73bbcb9c33035821ba0997e8544be696b9: Status 404 returned error can't find the container with id 85a94f730a61b185f201cb39df6a5a73bbcb9c33035821ba0997e8544be696b9 Jul 10 00:01:46.647060 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:46.647024 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" event={"ID":"4d757cb6-a873-49a2-b62d-912bbb8938ef","Type":"ContainerStarted","Data":"85a94f730a61b185f201cb39df6a5a73bbcb9c33035821ba0997e8544be696b9"} Jul 10 00:01:47.659864 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:47.659817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" event={"ID":"4d757cb6-a873-49a2-b62d-912bbb8938ef","Type":"ContainerStarted","Data":"05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce"} Jul 10 00:01:47.660471 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:47.659954 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:47.675667 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:47.675623 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" podStartSLOduration=1.876271761 podStartE2EDuration="2.675607237s" totalImagesPullingTime="799.335476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:01:47.674358569 +0000 UTC m=+2038.618272252" watchObservedRunningTime="2026-07-10 00:01:47.675607237 +0000 UTC m=+2038.619520920" Jul 10 00:01:53.670124 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.670093 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:01:53.927605 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.927523 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk"] Jul 10 00:01:53.930868 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.930844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:53.933883 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.933853 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b0ecf1-serving-cert\"" Jul 10 00:01:53.951934 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.951906 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk"] Jul 10 00:01:53.952071 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.952035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqp2r\" (UniqueName: \"kubernetes.io/projected/2cc533f6-be4e-4135-8787-7155dd07746e-kube-api-access-xqp2r\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:53.952133 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.952081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:53.952218 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:53.952197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc533f6-be4e-4135-8787-7155dd07746e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.053259 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.053222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc533f6-be4e-4135-8787-7155dd07746e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.053445 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.053306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2r\" (UniqueName: \"kubernetes.io/projected/2cc533f6-be4e-4135-8787-7155dd07746e-kube-api-access-xqp2r\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.053445 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.053363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.053559 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:01:54.053519 2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-serving-cert: secret "maas-api-e2e-shared-b-b0ecf1-serving-cert" not found Jul 10 00:01:54.053620 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:01:54.053611 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls podName:2cc533f6-be4e-4135-8787-7155dd07746e nodeName:}" failed. No retries permitted until 2026-07-10 00:01:54.553589832 +0000 UTC m=+2045.497503507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls") pod "maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" (UID: "2cc533f6-be4e-4135-8787-7155dd07746e") : secret "maas-api-e2e-shared-b-b0ecf1-serving-cert" not found Jul 10 00:01:54.053937 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.053918 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc533f6-be4e-4135-8787-7155dd07746e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.064910 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.064882 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqp2r\" (UniqueName: \"kubernetes.io/projected/2cc533f6-be4e-4135-8787-7155dd07746e-kube-api-access-xqp2r\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.557486 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.557446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.559956 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.559927 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls\") pod \"maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.843102 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.843003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:54.985872 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:54.985839 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk"] Jul 10 00:01:54.989220 ip-10-0-132-128 kubenswrapper[2578]: W0710 00:01:54.989188 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc533f6_be4e_4135_8787_7155dd07746e.slice/crio-b07e7ed1c895454d015bbcea31573af9c920a4f571034b59372958928863d52b WatchSource:0}: Error finding container b07e7ed1c895454d015bbcea31573af9c920a4f571034b59372958928863d52b: Status 404 returned error can't find the container with id b07e7ed1c895454d015bbcea31573af9c920a4f571034b59372958928863d52b Jul 10 00:01:55.700799 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:55.700761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" event={"ID":"2cc533f6-be4e-4135-8787-7155dd07746e","Type":"ContainerStarted","Data":"b07e7ed1c895454d015bbcea31573af9c920a4f571034b59372958928863d52b"} Jul 10 00:01:57.714546 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:57.714511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" event={"ID":"2cc533f6-be4e-4135-8787-7155dd07746e","Type":"ContainerStarted","Data":"ba6d738c2d8108989f15aa84da32944e0357067d46bc47d1aa0c61ffcce75ca8"} Jul 10 00:01:57.714949 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:57.714573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:01:57.731937 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:01:57.731886 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" podStartSLOduration=3.07075383 podStartE2EDuration="4.731872691s" totalImagesPullingTime="1.661118861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 00:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:01:57.729041696 +0000 UTC m=+2048.672955382" watchObservedRunningTime="2026-07-10 00:01:57.731872691 +0000 UTC m=+2048.675786373" Jul 10 00:02:03.725226 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:02:03.725188 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:02:49.688898 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:02:49.688873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 10 00:02:49.691482 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:02:49.690633 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 10 00:02:49.693892 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:02:49.693874 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 10 00:02:49.695402 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:02:49.695382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 10 00:07:14.449265 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:14.449226 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f"] Jul 10 00:07:14.449909 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:14.449531 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" podUID="4d757cb6-a873-49a2-b62d-912bbb8938ef" containerName="maas-api" containerID="cri-o://05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce" gracePeriod=30 Jul 10 00:07:14.902951 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:14.902920 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:07:15.005462 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.005367 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d757cb6-a873-49a2-b62d-912bbb8938ef-maas-api-tls\") pod \"4d757cb6-a873-49a2-b62d-912bbb8938ef\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " Jul 10 00:07:15.005462 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.005440 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tchg7\" (UniqueName: \"kubernetes.io/projected/4d757cb6-a873-49a2-b62d-912bbb8938ef-kube-api-access-tchg7\") pod \"4d757cb6-a873-49a2-b62d-912bbb8938ef\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " Jul 10 00:07:15.005649 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.005469 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d757cb6-a873-49a2-b62d-912bbb8938ef-openshift-service-ca\") pod \"4d757cb6-a873-49a2-b62d-912bbb8938ef\" (UID: \"4d757cb6-a873-49a2-b62d-912bbb8938ef\") " Jul 10 00:07:15.005913 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.005884 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d757cb6-a873-49a2-b62d-912bbb8938ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d757cb6-a873-49a2-b62d-912bbb8938ef" (UID: "4d757cb6-a873-49a2-b62d-912bbb8938ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 00:07:15.007653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.007633 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d757cb6-a873-49a2-b62d-912bbb8938ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d757cb6-a873-49a2-b62d-912bbb8938ef" (UID: "4d757cb6-a873-49a2-b62d-912bbb8938ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 00:07:15.007653 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.007644 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d757cb6-a873-49a2-b62d-912bbb8938ef-kube-api-access-tchg7" (OuterVolumeSpecName: "kube-api-access-tchg7") pod "4d757cb6-a873-49a2-b62d-912bbb8938ef" (UID: "4d757cb6-a873-49a2-b62d-912bbb8938ef"). InnerVolumeSpecName "kube-api-access-tchg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 00:07:15.106708 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.106668 2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d757cb6-a873-49a2-b62d-912bbb8938ef-maas-api-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:07:15.106708 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.106700 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tchg7\" (UniqueName: \"kubernetes.io/projected/4d757cb6-a873-49a2-b62d-912bbb8938ef-kube-api-access-tchg7\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:07:15.106708 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.106709 2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d757cb6-a873-49a2-b62d-912bbb8938ef-openshift-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:07:15.296493 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.296406 2578 generic.go:356] "Generic (PLEG): container finished" podID="4d757cb6-a873-49a2-b62d-912bbb8938ef" containerID="05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce" exitCode=0 Jul 10 00:07:15.296493 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.296449 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" Jul 10 00:07:15.296671 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.296488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" event={"ID":"4d757cb6-a873-49a2-b62d-912bbb8938ef","Type":"ContainerDied","Data":"05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce"} Jul 10 00:07:15.296671 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.296543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f" event={"ID":"4d757cb6-a873-49a2-b62d-912bbb8938ef","Type":"ContainerDied","Data":"85a94f730a61b185f201cb39df6a5a73bbcb9c33035821ba0997e8544be696b9"} Jul 10 00:07:15.296671 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.296567 2578 scope.go:117] "RemoveContainer" containerID="05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce" Jul 10 00:07:15.306048 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.306029 2578 scope.go:117] "RemoveContainer" containerID="05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce" Jul 10 00:07:15.306271 ip-10-0-132-128 kubenswrapper[2578]: E0710 00:07:15.306246 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce\": container with ID starting with 05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce not found: ID does not exist" containerID="05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce" Jul 10 00:07:15.306347 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.306304 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce"} err="failed to get container status \"05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce\": rpc error: code = NotFound desc = could not find container \"05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce\": container with ID starting with 05bd71e392d4804226c676cf1f82a2ab109b335bbc6c0aef51740e21e5a82cce not found: ID does not exist" Jul 10 00:07:15.316980 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.316957 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f"] Jul 10 00:07:15.325671 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.322391 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4c394e-69dcfb7ff9-mtk6f"] Jul 10 00:07:15.575452 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:15.575356 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d757cb6-a873-49a2-b62d-912bbb8938ef" path="/var/lib/kubelet/pods/4d757cb6-a873-49a2-b62d-912bbb8938ef/volumes" Jul 10 00:07:21.192043 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.192008 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk"] Jul 10 00:07:21.192532 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.192247 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" podUID="2cc533f6-be4e-4135-8787-7155dd07746e" containerName="maas-api" containerID="cri-o://ba6d738c2d8108989f15aa84da32944e0357067d46bc47d1aa0c61ffcce75ca8" gracePeriod=30 Jul 10 00:07:21.329468 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.329432 2578 generic.go:356] "Generic (PLEG): container finished" podID="2cc533f6-be4e-4135-8787-7155dd07746e" containerID="ba6d738c2d8108989f15aa84da32944e0357067d46bc47d1aa0c61ffcce75ca8" exitCode=0 Jul 10 00:07:21.329468 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.329478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" event={"ID":"2cc533f6-be4e-4135-8787-7155dd07746e","Type":"ContainerDied","Data":"ba6d738c2d8108989f15aa84da32944e0357067d46bc47d1aa0c61ffcce75ca8"} Jul 10 00:07:21.450428 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.450365 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:07:21.570987 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.570959 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls\") pod \"2cc533f6-be4e-4135-8787-7155dd07746e\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " Jul 10 00:07:21.571184 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.571053 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqp2r\" (UniqueName: \"kubernetes.io/projected/2cc533f6-be4e-4135-8787-7155dd07746e-kube-api-access-xqp2r\") pod \"2cc533f6-be4e-4135-8787-7155dd07746e\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " Jul 10 00:07:21.571184 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.571072 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc533f6-be4e-4135-8787-7155dd07746e-openshift-service-ca\") pod \"2cc533f6-be4e-4135-8787-7155dd07746e\" (UID: \"2cc533f6-be4e-4135-8787-7155dd07746e\") " Jul 10 00:07:21.571578 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.571551 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc533f6-be4e-4135-8787-7155dd07746e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cc533f6-be4e-4135-8787-7155dd07746e" (UID: "2cc533f6-be4e-4135-8787-7155dd07746e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 00:07:21.573298 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.573254 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cc533f6-be4e-4135-8787-7155dd07746e" (UID: "2cc533f6-be4e-4135-8787-7155dd07746e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 00:07:21.573391 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.573328 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc533f6-be4e-4135-8787-7155dd07746e-kube-api-access-xqp2r" (OuterVolumeSpecName: "kube-api-access-xqp2r") pod "2cc533f6-be4e-4135-8787-7155dd07746e" (UID: "2cc533f6-be4e-4135-8787-7155dd07746e"). InnerVolumeSpecName "kube-api-access-xqp2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 00:07:21.672690 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.672639 2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cc533f6-be4e-4135-8787-7155dd07746e-maas-api-tls\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:07:21.672690 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.672678 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqp2r\" (UniqueName: \"kubernetes.io/projected/2cc533f6-be4e-4135-8787-7155dd07746e-kube-api-access-xqp2r\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:07:21.672690 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:21.672689 2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cc533f6-be4e-4135-8787-7155dd07746e-openshift-service-ca\") on node \"ip-10-0-132-128.ec2.internal\" DevicePath \"\"" Jul 10 00:07:22.335189 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:22.335158 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" Jul 10 00:07:22.335189 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:22.335176 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk" event={"ID":"2cc533f6-be4e-4135-8787-7155dd07746e","Type":"ContainerDied","Data":"b07e7ed1c895454d015bbcea31573af9c920a4f571034b59372958928863d52b"} Jul 10 00:07:22.335760 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:22.335261 2578 scope.go:117] "RemoveContainer" containerID="ba6d738c2d8108989f15aa84da32944e0357067d46bc47d1aa0c61ffcce75ca8" Jul 10 00:07:22.351734 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:22.351706 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk"] Jul 10 00:07:22.355714 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:22.355692 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b0ecf1-55759bc749-2w5hk"] Jul 10 00:07:23.575593 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:23.575559 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc533f6-be4e-4135-8787-7155dd07746e" path="/var/lib/kubelet/pods/2cc533f6-be4e-4135-8787-7155dd07746e/volumes" Jul 10 00:07:33.155554 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:33.155526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55df6879-fnqlv_6f710dc0-07df-42be-88c3-40c9da9e3e37/copy-manifests/0.log" Jul 10 00:07:33.162062 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:33.162026 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55df6879-fnqlv_6f710dc0-07df-42be-88c3-40c9da9e3e37/manager/0.log" Jul 10 00:07:36.179399 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:36.179363 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bbsh9_4a5901f0-12b6-409a-a78b-8ae981d1fc1f/istio-proxy/0.log" Jul 10 00:07:36.286488 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:36.286454 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d4lcq_7d132a78-c948-492c-85fc-fc55558f0ffa/discovery/0.log" Jul 10 00:07:36.625957 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:36.625857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/1.log" Jul 10 00:07:36.734400 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:36.734360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zr89x_f2390289-734d-47ff-ad0f-8da2f9017198/payload-pre-processing/0.log" Jul 10 00:07:36.952377 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:36.952338 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc9f674b-6nzbm_cd0e2eff-74b5-4e26-90d9-395358c09246/router/0.log" Jul 10 00:07:37.392823 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:37.392743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qfpf2_20c38e8d-b656-43cd-b5bd-67d91617a5c8/main/0.log" Jul 10 00:07:37.603867 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:37.603834 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4p2cz_26567ac6-a9f6-4c27-9678-42506a6fda1f/main/0.log" Jul 10 00:07:37.817982 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:37.817952 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-k64qv_db5611ba-abb2-490c-b385-643432474d22/main/0.log" Jul 10 00:07:44.045410 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:44.045378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-slgdv_04aba92d-22f0-4ba7-a3af-f98ecabe63b9/global-pull-secret-syncer/0.log" Jul 10 00:07:44.194387 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:44.194358 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fz84m_4a957277-096c-4e67-83b0-c2bff331a7ff/konnectivity-agent/0.log" Jul 10 00:07:44.212696 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:44.212667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-128.ec2.internal_fad131b74fcb56c348327d4dd10f9830/haproxy/0.log" Jul 10 00:07:49.723852 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:49.723739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 10 00:07:49.728210 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:49.725430 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 10 00:07:49.728690 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:49.728670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 10 00:07:49.730452 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:49.730432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4cqlq_4c14e169-1d63-4633-aae0-f7f0ce812284/ovn-acl-logging/0.log" Jul 10 00:07:51.440808 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.440780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-8d2zp_7f6db721-b535-4f12-87e8-05e28aa59747/cluster-monitoring-operator/0.log" Jul 10 00:07:51.475249 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.475218 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wfn9j_c3c43201-6c12-44a5-a42c-e2acc86d9454/kube-state-metrics/0.log" Jul 10 00:07:51.495593 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.495562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wfn9j_c3c43201-6c12-44a5-a42c-e2acc86d9454/kube-rbac-proxy-main/0.log" Jul 10 00:07:51.518005 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.517978 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wfn9j_c3c43201-6c12-44a5-a42c-e2acc86d9454/kube-rbac-proxy-self/0.log" Jul 10 00:07:51.543257 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.543226 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b46b58c59-7vqkb_959fdd49-ebd3-471d-ba5c-45766a443b11/metrics-server/0.log" Jul 10 00:07:51.618037 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.617997 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkxj2_fc0ee224-41e6-4819-aaaa-d5644ffef19e/node-exporter/0.log" Jul 10 00:07:51.638079 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.638051 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkxj2_fc0ee224-41e6-4819-aaaa-d5644ffef19e/kube-rbac-proxy/0.log" Jul 10 00:07:51.661044 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.661018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kkxj2_fc0ee224-41e6-4819-aaaa-d5644ffef19e/init-textfile/0.log" Jul 10 00:07:51.866440 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.866362 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-46tfq_3b285dbd-5bd6-4e1e-a935-686b352f79c3/kube-rbac-proxy-main/0.log" Jul 10 00:07:51.892426 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.892401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-46tfq_3b285dbd-5bd6-4e1e-a935-686b352f79c3/kube-rbac-proxy-self/0.log" Jul 10 00:07:51.918191 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:51.918166 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-46tfq_3b285dbd-5bd6-4e1e-a935-686b352f79c3/openshift-state-metrics/0.log" Jul 10 00:07:53.575021 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:53.574992 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-q9tg5_0d374ed3-e2a3-4ad4-a821-73f1f41b8556/networking-console-plugin/0.log" Jul 10 00:07:54.041094 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041060 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn"] Jul 10 00:07:54.041559 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041535 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc533f6-be4e-4135-8787-7155dd07746e" containerName="maas-api" Jul 10 00:07:54.041741 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041718 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc533f6-be4e-4135-8787-7155dd07746e" containerName="maas-api" Jul 10 00:07:54.041839 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041781 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d757cb6-a873-49a2-b62d-912bbb8938ef" containerName="maas-api" Jul 10 00:07:54.041839 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041792 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d757cb6-a873-49a2-b62d-912bbb8938ef" containerName="maas-api" Jul 10 00:07:54.041908 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041891 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d757cb6-a873-49a2-b62d-912bbb8938ef" containerName="maas-api" Jul 10 00:07:54.041908 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.041899 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc533f6-be4e-4135-8787-7155dd07746e" containerName="maas-api" Jul 10 00:07:54.046215 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.046196 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.048114 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.048094 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9scwp\"/\"openshift-service-ca.crt\"" Jul 10 00:07:54.048224 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.048202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9scwp\"/\"kube-root-ca.crt\"" Jul 10 00:07:54.049125 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.049095 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9scwp\"/\"default-dockercfg-vnv75\"" Jul 10 00:07:54.055299 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.055263 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn"] Jul 10 00:07:54.081523 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.081490 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-lib-modules\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.081684 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.081552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-podres\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.081684 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.081594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbb72\" (UniqueName: \"kubernetes.io/projected/92e20b72-b3fb-4031-8458-36ce91558a36-kube-api-access-bbb72\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.081684 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.081669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-proc\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.081791 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.081685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-sys\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182203 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-proc\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182203 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-sys\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-lib-modules\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-podres\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-sys\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182327 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-proc\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182420 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbb72\" (UniqueName: \"kubernetes.io/projected/92e20b72-b3fb-4031-8458-36ce91558a36-kube-api-access-bbb72\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182581 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-podres\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.182581 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.182448 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92e20b72-b3fb-4031-8458-36ce91558a36-lib-modules\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.189431 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.189407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbb72\" (UniqueName: \"kubernetes.io/projected/92e20b72-b3fb-4031-8458-36ce91558a36-kube-api-access-bbb72\") pod \"perf-node-gather-daemonset-v8xsn\" (UID: \"92e20b72-b3fb-4031-8458-36ce91558a36\") " pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.197737 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.197715 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/1.log" Jul 10 00:07:54.203119 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.203099 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8wddq_299ab99b-6b60-4774-b7b9-ddf0a2d66c61/console-operator/2.log" Jul 10 00:07:54.357140 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.357043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:54.495036 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:54.495009 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn"] Jul 10 00:07:54.497661 ip-10-0-132-128 kubenswrapper[2578]: W0710 00:07:54.497628 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92e20b72_b3fb_4031_8458_36ce91558a36.slice/crio-dffe16203280e31d3709319f5a028672c8971e3695c4634218d424b720b2e4e5 WatchSource:0}: Error finding container dffe16203280e31d3709319f5a028672c8971e3695c4634218d424b720b2e4e5: Status 404 returned error can't find the container with id dffe16203280e31d3709319f5a028672c8971e3695c4634218d424b720b2e4e5 Jul 10 00:07:55.430563 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:55.430534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-w6bgm_cbf32290-dc86-4302-8577-c0380098441f/volume-data-source-validator/0.log" Jul 10 00:07:55.508786 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:55.508749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" event={"ID":"92e20b72-b3fb-4031-8458-36ce91558a36","Type":"ContainerStarted","Data":"89f9890aef1e838f11e7bdcb2ecbc96d10ed136abcbae36dcc8d7dc5bf355308"} Jul 10 00:07:55.508947 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:55.508811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" event={"ID":"92e20b72-b3fb-4031-8458-36ce91558a36","Type":"ContainerStarted","Data":"dffe16203280e31d3709319f5a028672c8971e3695c4634218d424b720b2e4e5"} Jul 10 00:07:55.508947 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:55.508931 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:07:55.524333 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:55.524272 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" podStartSLOduration=1.5242563040000001 podStartE2EDuration="1.524256304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 00:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 00:07:55.5221232 +0000 UTC m=+2406.466036884" watchObservedRunningTime="2026-07-10 00:07:55.524256304 +0000 UTC m=+2406.468169987" Jul 10 00:07:56.431566 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:56.431532 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x42vz_727cf0c4-0e31-47bf-82f6-902f8b4f4788/dns/0.log" Jul 10 00:07:56.452673 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:56.452635 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x42vz_727cf0c4-0e31-47bf-82f6-902f8b4f4788/kube-rbac-proxy/0.log" Jul 10 00:07:56.552515 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:56.552484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlrbx_278e24fb-2d93-4155-a625-061bf06dbad6/dns-node-resolver/0.log" Jul 10 00:07:57.055199 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:57.055164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29727360-7vltd_f212a5c4-8906-4c23-9f82-7bb205c06d8c/image-pruner/0.log" Jul 10 00:07:57.128672 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:57.128647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cslvf_a5f0b288-4c39-4817-bcb3-fc65a89a3d74/node-ca/0.log" Jul 10 00:07:58.031771 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:58.031743 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bbsh9_4a5901f0-12b6-409a-a78b-8ae981d1fc1f/istio-proxy/0.log" Jul 10 00:07:58.142195 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:58.142160 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d4lcq_7d132a78-c948-492c-85fc-fc55558f0ffa/discovery/0.log" Jul 10 00:07:58.210498 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:58.210465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/0.log" Jul 10 00:07:58.238843 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:58.238810 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/1.log" Jul 10 00:07:58.268806 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:58.268777 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zr89x_f2390289-734d-47ff-ad0f-8da2f9017198/payload-pre-processing/0.log" Jul 10 00:07:58.326010 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:58.325919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc9f674b-6nzbm_cd0e2eff-74b5-4e26-90d9-395358c09246/router/0.log" Jul 10 00:07:59.023674 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:59.023647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ftjx9_e1202104-1f50-4ce0-b150-0547eef9fb04/serve-healthcheck-canary/0.log" Jul 10 00:07:59.466582 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:59.466542 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-s5pz5_6b50f254-b6a1-4c08-9be2-8b3469e57f4a/insights-operator/0.log" Jul 10 00:07:59.467016 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:59.466933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-s5pz5_6b50f254-b6a1-4c08-9be2-8b3469e57f4a/insights-operator/1.log" Jul 10 00:07:59.620963 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:59.620934 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqcrm_6c99cbba-b226-4a3b-8df3-241fcbf4ebbc/kube-rbac-proxy/0.log" Jul 10 00:07:59.640024 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:59.640000 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqcrm_6c99cbba-b226-4a3b-8df3-241fcbf4ebbc/exporter/0.log" Jul 10 00:07:59.660435 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:07:59.660410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqcrm_6c99cbba-b226-4a3b-8df3-241fcbf4ebbc/extractor/0.log" Jul 10 00:08:01.523956 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:01.523929 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9scwp/perf-node-gather-daemonset-v8xsn" Jul 10 00:08:02.144499 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:02.144461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55df6879-fnqlv_6f710dc0-07df-42be-88c3-40c9da9e3e37/manager/0.log" Jul 10 00:08:02.166514 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:02.166489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c55df6879-fnqlv_6f710dc0-07df-42be-88c3-40c9da9e3e37/copy-manifests/0.log" Jul 10 00:08:03.689776 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:03.689736 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c889b46bf-8p89r_a0fa01a0-2a10-46ff-8746-072e8804234c/manager/0.log" Jul 10 00:08:05.188747 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:05.188667 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bbsh9_4a5901f0-12b6-409a-a78b-8ae981d1fc1f/istio-proxy/0.log" Jul 10 00:08:05.289574 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:05.289538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d4lcq_7d132a78-c948-492c-85fc-fc55558f0ffa/discovery/0.log" Jul 10 00:08:05.337657 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:05.337628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/0.log" Jul 10 00:08:05.365836 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:05.365811 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/1.log" Jul 10 00:08:05.386939 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:05.386903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zr89x_f2390289-734d-47ff-ad0f-8da2f9017198/payload-pre-processing/0.log" Jul 10 00:08:05.433856 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:05.433828 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc9f674b-6nzbm_cd0e2eff-74b5-4e26-90d9-395358c09246/router/0.log" Jul 10 00:08:06.677938 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:06.677909 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678bbsh9_4a5901f0-12b6-409a-a78b-8ae981d1fc1f/istio-proxy/0.log" Jul 10 00:08:06.789185 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:06.789154 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d4lcq_7d132a78-c948-492c-85fc-fc55558f0ffa/discovery/0.log" Jul 10 00:08:06.840652 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:06.840618 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/0.log" Jul 10 00:08:06.872097 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:06.872066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-mtbc8_68de50f7-ec80-4781-98ce-82682f4cea75/istio-proxy/1.log" Jul 10 00:08:06.891880 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:06.891854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zr89x_f2390289-734d-47ff-ad0f-8da2f9017198/payload-pre-processing/0.log" Jul 10 00:08:06.935100 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:06.935023 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56cc9f674b-6nzbm_cd0e2eff-74b5-4e26-90d9-395358c09246/router/0.log" Jul 10 00:08:09.225859 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:09.225826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-v5j9s_672628e9-b64d-44be-b21e-654b8af50047/kube-storage-version-migrator-operator/1.log" Jul 10 00:08:09.226675 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:09.226653 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-v5j9s_672628e9-b64d-44be-b21e-654b8af50047/kube-storage-version-migrator-operator/0.log" Jul 10 00:08:10.153721 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.153646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5xkjt_6790f8b4-edf2-43dd-9629-9af878cd7e64/kube-multus/0.log" Jul 10 00:08:10.317552 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.317524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/kube-multus-additional-cni-plugins/0.log" Jul 10 00:08:10.335951 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.335916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/egress-router-binary-copy/0.log" Jul 10 00:08:10.353826 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.353799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/cni-plugins/0.log" Jul 10 00:08:10.371104 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.371083 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/bond-cni-plugin/0.log" Jul 10 00:08:10.389004 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.388979 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/routeoverride-cni/0.log" Jul 10 00:08:10.406847 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.406780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/whereabouts-cni-bincopy/0.log" Jul 10 00:08:10.424802 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.424779 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99gjz_fd89832e-5e36-43c1-ac55-44d6349ccf9b/whereabouts-cni/0.log" Jul 10 00:08:10.689499 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.689470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kr4rb_9327c044-5bf6-4c2b-9809-ac5d277649a6/network-metrics-daemon/0.log" Jul 10 00:08:10.706643 ip-10-0-132-128 kubenswrapper[2578]: I0710 00:08:10.706619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kr4rb_9327c044-5bf6-4c2b-9809-ac5d277649a6/kube-rbac-proxy/0.log"