Jul 18 03:50:00.283496 ip-10-0-133-144 systemd[1]: Starting Kubernetes Kubelet... Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.727558 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733812 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733831 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733835 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733838 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733841 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733844 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733849 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:50:00.757329 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733852 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733855 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733858 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733861 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733864 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733866 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733869 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733872 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733875 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733877 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733880 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733883 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733885 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733888 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733890 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733893 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733896 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733898 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733901 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733903 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:50:00.834707 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733906 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:50:00.810264 ip-10-0-133-144 systemd[1]: Started Kubernetes Kubelet. Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733909 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733911 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733914 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733918 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733920 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733923 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733926 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733929 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733932 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733934 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733937 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733940 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733943 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733946 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733948 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733951 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733954 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733956 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733959 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:50:00.851298 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733963 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733968 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733971 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733983 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733986 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733989 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733993 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733996 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.733998 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734003 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734007 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734010 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734013 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734016 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734019 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734022 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734025 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734028 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:50:00.881237 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734030 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734033 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734036 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734039 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734042 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734045 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734049 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734051 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734056 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734059 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734062 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734064 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734067 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734070 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734073 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734075 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734078 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734080 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734089 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734092 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:50:00.903114 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734095 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734097 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734100 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734102 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734105 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734107 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734110 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734113 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734115 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734118 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734121 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734123 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734127 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734131 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734918 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734928 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734931 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734934 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734936 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:50:00.905738 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734939 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734942 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734945 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734948 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734950 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734953 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734956 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734958 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734961 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734963 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734966 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734969 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734973 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734975 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734978 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734980 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734983 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734986 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734988 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734990 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:50:01.051455 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734993 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734995 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.734998 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735000 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735004 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735009 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735013 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735016 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735019 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735022 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735024 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735027 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735029 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735032 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735034 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735037 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735039 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735042 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735045 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735047 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:50:01.053694 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735050 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735055 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735057 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735060 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735062 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735066 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735069 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735071 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735074 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735077 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735079 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735082 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735084 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735087 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735089 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735092 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735094 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735098 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735104 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:50:01.054375 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735107 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735111 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735115 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735118 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735121 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735124 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735128 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735131 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735134 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735137 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735140 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735142 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735145 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735148 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735152 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735155 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735157 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735160 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735162 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735165 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:50:01.055359 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735168 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735171 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735173 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735176 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735179 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735181 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735184 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735205 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735208 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735210 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735213 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735217 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735220 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735223 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735225 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735590 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735596 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735599 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735601 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735604 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:50:01.056008 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735606 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735609 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735611 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735614 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735616 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735619 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735624 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735627 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735630 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735632 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735636 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735640 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735643 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735646 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735648 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735651 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735653 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735656 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735658 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735661 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:50:01.056701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735663 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735666 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735668 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735672 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735675 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735678 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735680 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735683 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735686 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735688 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735691 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735693 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735696 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735699 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735702 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735704 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735707 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735709 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735713 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735716 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:50:01.057650 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735718 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735728 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735731 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735734 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735738 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735741 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735744 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735747 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735750 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735753 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735755 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735759 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735763 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735766 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735768 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735773 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735776 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735778 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735781 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:50:01.058355 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735784 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735786 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735790 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735792 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735795 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735797 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735800 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735802 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735805 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735807 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735810 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735813 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735816 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735819 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735821 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735824 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735826 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735829 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735832 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735834 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:50:01.058898 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735837 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735840 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735842 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735844 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735847 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735850 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735852 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735855 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735859 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735861 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735864 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735867 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735869 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735872 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.735874 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735944 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735951 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735957 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735962 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735966 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735969 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 03:50:01.059645 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735973 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735977 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735981 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735984 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735988 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735991 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735994 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.735997 2583 flags.go:64] FLAG: --cgroup-root="" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736000 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736003 2583 flags.go:64] FLAG: --client-ca-file="" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736012 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736015 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736019 2583 flags.go:64] FLAG: --cluster-domain="" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736022 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736025 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736028 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736031 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736035 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736038 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736042 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736046 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736049 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736052 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736055 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 03:50:01.060423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736058 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736060 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736064 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736068 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736070 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736073 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736076 2583 flags.go:64] FLAG: --enable-server="true" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736079 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736084 2583 flags.go:64] FLAG: --event-burst="100" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736087 2583 flags.go:64] FLAG: --event-qps="50" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736092 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736095 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736098 2583 flags.go:64] FLAG: --eviction-hard="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736101 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736104 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736107 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736110 2583 flags.go:64] FLAG: --eviction-soft="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736113 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736116 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736120 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736122 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736126 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736129 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736132 2583 flags.go:64] FLAG: --feature-gates="" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736135 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 03:50:01.304262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736138 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736141 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736146 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736149 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736152 2583 flags.go:64] FLAG: --help="false" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736155 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-133-144.ec2.internal" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736158 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736161 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736164 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736167 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736170 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736173 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736176 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736179 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736182 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736185 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736204 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736208 2583 flags.go:64] FLAG: --kube-reserved="" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736211 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736214 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736217 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736220 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736223 2583 flags.go:64] FLAG: --lock-file="" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736226 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 03:50:01.305105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736229 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736232 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736237 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736241 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736244 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736247 2583 flags.go:64] FLAG: --logging-format="text" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736250 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736253 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736256 2583 flags.go:64] FLAG: --manifest-url="" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736259 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736269 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736273 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736276 2583 flags.go:64] FLAG: --max-pods="110" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736279 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736282 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736285 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736288 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736291 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736294 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736297 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736304 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736308 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736311 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 03:50:01.306064 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736314 2583 flags.go:64] FLAG: --pod-cidr="" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736317 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736322 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736327 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736330 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736333 2583 flags.go:64] FLAG: --port="10250" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736336 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736339 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00ae2a4be1efa7ad8" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736343 2583 flags.go:64] FLAG: --qos-reserved="" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736345 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736348 2583 flags.go:64] FLAG: --register-node="true" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736351 2583 flags.go:64] FLAG: --register-with-taints="" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736354 2583 flags.go:64] FLAG: --registry-burst="10" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736358 2583 flags.go:64] FLAG: --registry-qps="5" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736361 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736365 2583 flags.go:64] FLAG: --reserved-memory="" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736368 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736371 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736374 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736378 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736381 2583 flags.go:64] FLAG: --runonce="false" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736384 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736387 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736390 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736393 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 03:50:01.306705 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736396 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736399 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736402 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736405 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736408 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736411 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736414 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736416 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736419 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736422 2583 flags.go:64] FLAG: --system-cgroups="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736426 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736431 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736434 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736437 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736441 2583 flags.go:64] FLAG: --tls-min-version="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736444 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736446 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736449 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736452 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736455 2583 flags.go:64] FLAG: --v="2" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736459 2583 flags.go:64] FLAG: --version="false" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736463 2583 flags.go:64] FLAG: --vmodule="" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736467 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.736471 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736585 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:50:02.633045 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736589 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736595 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736598 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736601 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736603 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736607 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736609 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736612 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736614 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736617 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736620 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736622 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736624 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736627 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736630 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736633 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736635 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736639 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736642 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736645 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:50:02.635475 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736648 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736650 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736653 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736655 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736658 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736661 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736665 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736669 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736671 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736675 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736678 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736681 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736683 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736687 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736689 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736692 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736696 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736700 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736703 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736706 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:50:02.636371 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736709 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736712 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736715 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736718 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736720 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736723 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736726 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736729 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736731 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736735 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736738 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736740 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736743 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736745 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736748 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736750 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736753 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736755 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736758 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:50:02.637925 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736760 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736764 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736767 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736771 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736774 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736777 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736781 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736784 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736787 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736790 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736793 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736796 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736799 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736801 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736804 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736807 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736809 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736811 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736814 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:50:02.638459 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736816 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736819 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736821 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736826 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736828 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736831 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736833 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736836 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736838 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736841 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736843 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736846 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736849 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736851 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736854 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736856 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736859 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736868 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736871 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:50:02.639654 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.736875 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.737623 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.744750 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.744767 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.745687 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.745694 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745752 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745757 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745761 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745764 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745767 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745770 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745774 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745777 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745780 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:50:02.640590 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745782 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745785 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745788 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745792 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745796 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745799 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745802 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745805 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745808 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745810 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745813 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745817 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745820 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745823 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745827 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745831 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745833 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745836 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745839 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:50:02.641276 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745841 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745845 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745847 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745851 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745853 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745856 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745859 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745861 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745864 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745866 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745869 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745872 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745874 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745877 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745879 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745882 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745884 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745887 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745889 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:50:02.642834 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745894 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745897 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745900 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745902 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745905 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745908 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745911 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745914 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745921 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745924 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745927 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745930 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745933 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745935 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745938 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745941 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745944 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745947 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745950 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:50:02.643356 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745953 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745955 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745958 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745961 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745963 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745966 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745969 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745972 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745975 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745977 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745980 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745982 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745985 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745987 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745990 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745992 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745995 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.745997 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746000 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746003 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:50:02.643831 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746005 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746010 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746012 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746015 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746017 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746020 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746023 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746025 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746028 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746031 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746033 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746036 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746039 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.746044 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746171 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 03:50:02.644318 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746175 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746178 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746182 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746200 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746204 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746207 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746212 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746215 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746217 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746220 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746223 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746225 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746228 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746231 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746233 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746236 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746239 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746241 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746245 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 03:50:02.644701 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746248 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746251 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746253 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746256 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746259 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746261 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746264 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746267 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746271 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746274 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746277 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746280 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746283 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746286 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746289 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746291 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746294 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746297 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746299 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 03:50:02.645200 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746303 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746305 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746308 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746311 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746313 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746316 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746318 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746321 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746323 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746326 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746328 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746331 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746335 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746338 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746341 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746344 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746346 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746348 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746351 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746354 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746356 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 03:50:02.645676 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746358 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746363 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746367 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746370 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746373 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746375 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746378 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746380 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746383 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746386 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746389 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746392 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746395 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746398 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746400 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746403 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746406 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746408 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746411 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746414 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 03:50:02.646192 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746416 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746419 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746421 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746425 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746428 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746430 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746433 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746435 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746438 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746440 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746443 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746445 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746448 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746450 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746453 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746456 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746458 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746461 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 03:50:02.646693 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:00.746463 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.746467 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.746587 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.750583 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.752330 2583 server.go:1019] "Starting client certificate rotation" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.752433 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.753308 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.755241 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.756838 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.768873 2583 log.go:25] "Validated CRI v1 runtime API" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.772680 2583 log.go:25] "Validated CRI v1 image API" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.773536 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 03:50:02.647124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.777789 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ad6e4d6-2200-44d5-8f28-bef8e8a4ff7f:/dev/nvme0n1p3 e51facfc-727e-44b5-8c41-2064b7b67d0a:/dev/nvme0n1p4] Jul 18 03:50:02.647441 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.777805 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 03:50:02.647441 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.780288 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.784684 2583 manager.go:216] Machine: {Timestamp:2026-07-18 03:50:00.783279749 +0000 UTC m=+0.371756285 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096865 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249882f6bcae5225f73e19fcd38f9c SystemUUID:ec249882-f6bc-ae52-25f7-3e19fcd38f9c BootID:85b363d4-4c74-4bea-8b25-23480ce0b47a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:92:c1:60:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:92:c1:60:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:28:d9:f8:10:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.784785 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.784863 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.788426 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.788458 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.789292 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.789303 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.789310 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.790085 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.792026 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.796791 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.796920 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.796949 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.796962 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.796979 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.796992 2583 kubelet.go:398] "Adding apiserver pod source" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.797000 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 03:50:02.647500 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.797381 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.797400 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.797801 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x4dq4" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.800484 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.802943 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x4dq4" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.803183 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.803236 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804789 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804804 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804810 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804816 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804826 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804831 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804855 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804861 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804867 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804873 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804889 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.804901 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.805788 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.805795 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.809346 2583 server.go:1268] "Started kubelet" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.809422 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.809420 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.809870 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.809902 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.809903 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.810064 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.811433 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.812062 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.815017 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821200 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821212 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.821262 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821839 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821852 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821858 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821904 2583 factory.go:55] Registering systemd factory Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821919 2583 factory.go:223] Registration of the systemd container factory successfully Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821953 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.821962 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.822106 2583 factory.go:153] Registering CRI-O factory Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.822117 2583 factory.go:223] Registration of the crio container factory successfully Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.822160 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.822201 2583 factory.go:103] Registering Raw factory Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.822217 2583 manager.go:1196] Started watching for new ooms in manager Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.822532 2583 manager.go:349] Starting recovery of all containers Jul 18 03:50:02.647973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.823499 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.826119 2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-144.ec2.internal\" not found" node="ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.830364 2583 manager.go:354] Recovery completed Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.834286 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.837507 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.837532 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.837546 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838140 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838150 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838157 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838176 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838893 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838917 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.838927 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.840347 2583 policy_none.go:49] "None policy: Start" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.840361 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.840371 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.842315 2583 policy_none.go:47] "Start" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.921710 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.928605 2583 manager.go:337] "Starting Device Plugin manager" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.928696 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.928709 2583 server.go:87] "Starting device plugin registration server" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.928977 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.928992 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.929062 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.929144 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.929153 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.929755 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.929802 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.953532 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.954814 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.954850 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.954870 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:00.954898 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:00.957034 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.029223 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.030229 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.030258 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.030273 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.030302 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.039147 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.039171 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-144.ec2.internal\": node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.053055 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.055216 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal"] Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.055269 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.056764 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.649166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.056789 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.056798 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059057 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059253 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059279 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059796 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059803 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059827 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059831 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059838 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.059846 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.061962 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.061985 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.062596 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientMemory" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.062615 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.062625 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeHasSufficientPID" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.095056 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-144.ec2.internal\" not found" node="ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.102257 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-144.ec2.internal\" not found" node="ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.123647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64eb37ed0ac65b2b2fec0d5bd2802157-config\") pod \"kube-apiserver-proxy-ip-10-0-133-144.ec2.internal\" (UID: \"64eb37ed0ac65b2b2fec0d5bd2802157\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.123669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c580114a4f37ef1d27be9bc29b0710f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal\" (UID: \"3c580114a4f37ef1d27be9bc29b0710f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.123687 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c580114a4f37ef1d27be9bc29b0710f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal\" (UID: \"3c580114a4f37ef1d27be9bc29b0710f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.153907 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.224415 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64eb37ed0ac65b2b2fec0d5bd2802157-config\") pod \"kube-apiserver-proxy-ip-10-0-133-144.ec2.internal\" (UID: \"64eb37ed0ac65b2b2fec0d5bd2802157\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.224442 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64eb37ed0ac65b2b2fec0d5bd2802157-config\") pod \"kube-apiserver-proxy-ip-10-0-133-144.ec2.internal\" (UID: \"64eb37ed0ac65b2b2fec0d5bd2802157\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.224491 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c580114a4f37ef1d27be9bc29b0710f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal\" (UID: \"3c580114a4f37ef1d27be9bc29b0710f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.224509 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c580114a4f37ef1d27be9bc29b0710f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal\" (UID: \"3c580114a4f37ef1d27be9bc29b0710f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.224552 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c580114a4f37ef1d27be9bc29b0710f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal\" (UID: \"3c580114a4f37ef1d27be9bc29b0710f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.224571 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c580114a4f37ef1d27be9bc29b0710f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal\" (UID: \"3c580114a4f37ef1d27be9bc29b0710f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.254476 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.355209 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.398387 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:01.405238 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:01.455735 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.650962 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:02.632315 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.732828 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:02.732795 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.827447 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.827414 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 03:50:02.827616 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.827566 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 03:50:02.827671 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.827603 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 03:50:02.833694 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:02.833675 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-144.ec2.internal\" not found" Jul 18 03:50:02.886115 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.886001 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 03:45:01 +0000 UTC" deadline="2028-04-11 04:58:56.613193508 +0000 UTC" Jul 18 03:50:02.886115 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.886063 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15193h8m53.727134808s" Jul 18 03:50:02.896874 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.896852 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:02.897831 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.897814 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 03:50:02.897924 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.897837 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.908713 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.908691 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 03:50:02.910066 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.910050 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" Jul 18 03:50:02.910761 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.910742 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 03:50:02.916124 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:02.916109 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 03:50:03.008471 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.008442 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdcdp" Jul 18 03:50:03.012644 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.012618 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wdcdp" Jul 18 03:50:03.081173 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:03.081137 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64eb37ed0ac65b2b2fec0d5bd2802157.slice/crio-608963745a65f57fc9919693064edd73c288bbf4877c6ada38a6baccd0d90877 WatchSource:0}: Error finding container 608963745a65f57fc9919693064edd73c288bbf4877c6ada38a6baccd0d90877: Status 404 returned error can't find the container with id 608963745a65f57fc9919693064edd73c288bbf4877c6ada38a6baccd0d90877 Jul 18 03:50:03.086001 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.085985 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 03:50:03.189017 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.188941 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:03.215280 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:03.215253 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c580114a4f37ef1d27be9bc29b0710f.slice/crio-9c8c8f53e3d4332302fd65ecf08f6dce8559ea3f54ab3dfb1beb6aafe3fae702 WatchSource:0}: Error finding container 9c8c8f53e3d4332302fd65ecf08f6dce8559ea3f54ab3dfb1beb6aafe3fae702: Status 404 returned error can't find the container with id 9c8c8f53e3d4332302fd65ecf08f6dce8559ea3f54ab3dfb1beb6aafe3fae702 Jul 18 03:50:03.873993 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.873956 2583 apiserver.go:52] "Watching apiserver" Jul 18 03:50:03.883755 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.883707 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 03:50:03.884145 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.884116 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-8f6tt","openshift-network-operator/iptables-alerter-frppt","openshift-ovn-kubernetes/ovnkube-node-tmqh8","kube-system/global-pull-secret-syncer-mkj45","kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562","openshift-cluster-node-tuning-operator/tuned-r42rz","openshift-dns/node-resolver-kglbm","openshift-image-registry/node-ca-jrzq9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal","kube-system/konnectivity-agent-wqp22","openshift-multus/multus-additional-cni-plugins-m4rhg","openshift-multus/multus-crbwg","openshift-multus/network-metrics-daemon-gdzq9"] Jul 18 03:50:03.886888 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.886685 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:03.886888 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:03.886796 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:03.889534 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.889320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:03.891737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.891596 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9g24\"" Jul 18 03:50:03.891737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.891625 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.891737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.891649 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 03:50:03.891737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.891610 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.892631 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.892252 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.894288 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894243 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.894458 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894408 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.894458 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894441 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rk5xs\"" Jul 18 03:50:03.894649 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894630 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:03.894717 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:03.894687 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:03.894770 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894756 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 03:50:03.894838 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894817 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 03:50:03.894884 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894756 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 03:50:03.894884 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.894871 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 03:50:03.896845 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.896828 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.898742 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.898721 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 03:50:03.898861 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.898761 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tzvx5\"" Jul 18 03:50:03.899007 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.898989 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.899084 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.899006 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.899245 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.899226 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.902073 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.901841 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.902073 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.901876 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5b82r\"" Jul 18 03:50:03.902073 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.901917 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.902766 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.902545 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:03.904591 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.904571 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.904802 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.904784 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tpzqv\"" Jul 18 03:50:03.904880 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.904866 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.906263 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.906247 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:03.908135 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.908111 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9dq85\"" Jul 18 03:50:03.908622 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.908425 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.908622 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.908481 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 03:50:03.908802 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.908655 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.908802 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.908721 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:03.909271 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8n9r\" (UniqueName: \"kubernetes.io/projected/b8947b1d-7879-4779-8c54-dc5584fd1ad8-kube-api-access-p8n9r\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:03.909370 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909275 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-systemd-units\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909370 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-slash\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909483 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-ovn\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909483 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909424 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-log-socket\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909581 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909492 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909581 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909533 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-env-overrides\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909581 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909566 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-registration-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.909737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909619 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-cni-netd\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovnkube-config\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909679 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovnkube-script-lib\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.909737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85ed711a-4175-4ddd-97c9-bb033d8c2c66-dbus\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysctl-d\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909757 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-run\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909783 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-var-lib-kubelet\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909815 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909843 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-sys-fs\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.909949 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-host\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910004 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-kubelet\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-var-lib-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910065 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-etc-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-node-log\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910108 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-cni-bin\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovn-node-metrics-cert\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910196 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910264 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd8bd279-995f-4049-9a68-0bebd8f32207-tmp\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910315 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8947b1d-7879-4779-8c54-dc5584fd1ad8-iptables-alerter-script\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910357 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85ed711a-4175-4ddd-97c9-bb033d8c2c66-kubelet-config\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910401 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-socket-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-device-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.910449 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910442 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-modprobe-d\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910475 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-tuned\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8947b1d-7879-4779-8c54-dc5584fd1ad8-host-slash\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910614 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysctl-conf\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-sys\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-lib-modules\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910734 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-systemd\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910774 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p596\" (UniqueName: \"kubernetes.io/projected/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-kube-api-access-7p596\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910869 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-run-netns\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910876 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rr4hc\"" Jul 18 03:50:03.910937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkb6\" (UniqueName: \"kubernetes.io/projected/2763fc72-bce3-4be5-af02-dc665f4d25fb-kube-api-access-nfkb6\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:03.911582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910960 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysconfig\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.911582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.910985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-kubernetes\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.911582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.911001 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 03:50:03.911582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.911005 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-systemd\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.911582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.911054 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f65gh\" (UniqueName: \"kubernetes.io/projected/cd8bd279-995f-4049-9a68-0bebd8f32207-kube-api-access-f65gh\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:03.911582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.911249 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:03.913193 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.913160 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 03:50:03.913479 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.913451 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 03:50:03.913609 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.913525 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 03:50:03.915208 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.915184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crbwg" Jul 18 03:50:03.915390 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.915372 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 03:50:03.917066 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.916707 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t9xp2\"" Jul 18 03:50:03.917493 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.917243 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 03:50:03.917493 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.917243 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 03:50:03.920315 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.920276 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:03.920454 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:03.920424 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:03.920839 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.920824 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxjgr\"" Jul 18 03:50:03.998823 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:03.998793 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 03:50:04.011352 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysctl-conf\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.011515 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-sys\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.011515 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011459 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p654q\" (UniqueName: \"kubernetes.io/projected/1eaa3070-fda9-4718-ba72-caf6ec05585f-kube-api-access-p654q\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.011515 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011481 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cnibin\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.011515 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-conf-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011520 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/571383bd-4549-4e92-b7ad-124d82c0a842-multus-daemon-config\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011534 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-sys\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011564 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysctl-conf\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011572 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7c2f\" (UniqueName: \"kubernetes.io/projected/571383bd-4549-4e92-b7ad-124d82c0a842-kube-api-access-t7c2f\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-systemd\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p596\" (UniqueName: \"kubernetes.io/projected/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-kube-api-access-7p596\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011654 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-systemd\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011668 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.011712 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011696 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-cni-multus\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-run-netns\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011748 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkb6\" (UniqueName: \"kubernetes.io/projected/2763fc72-bce3-4be5-af02-dc665f4d25fb-kube-api-access-nfkb6\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-systemd\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011793 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-run-netns\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011801 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f65gh\" (UniqueName: \"kubernetes.io/projected/cd8bd279-995f-4049-9a68-0bebd8f32207-kube-api-access-f65gh\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011836 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cni-binary-copy\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-cnibin\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011891 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-netns\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-log-socket\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011943 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-env-overrides\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.011990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysctl-d\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012049 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-systemd\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012100 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-log-socket\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012145 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-os-release\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012194 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysctl-d\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-sys-fs\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-host\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012254 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-sys-fs\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012272 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-kubelet\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-var-lib-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012315 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-host\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012336 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-etc-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012353 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-kubelet\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-cni-bin\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012387 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-var-lib-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovn-node-metrics-cert\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012418 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-etc-openvswitch\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-serviceca\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-cni-bin\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.012933 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/571383bd-4549-4e92-b7ad-124d82c0a842-cni-binary-copy\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85ed711a-4175-4ddd-97c9-bb033d8c2c66-kubelet-config\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012507 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-modprobe-d\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-tuned\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012556 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-cni-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012588 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-k8s-cni-cncf-io\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012692 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-kubelet\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012719 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-env-overrides\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012731 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-hostroot\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012758 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012845 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-modprobe-d\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-lib-modules\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012867 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012882 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012907 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85ed711a-4175-4ddd-97c9-bb033d8c2c66-kubelet-config\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.013744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012963 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-etc-selinux\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-lib-modules\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.012976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fl8x\" (UniqueName: \"kubernetes.io/projected/41787ee1-0ac0-4a06-a47e-9db479999abd-kube-api-access-6fl8x\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013012 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzp7\" (UniqueName: \"kubernetes.io/projected/bbc8f9e0-4d62-4591-8e44-b75618f15c29-kube-api-access-wgzp7\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013107 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013104 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-socket-dir-parent\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysconfig\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013185 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-kubernetes\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013235 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-kubernetes\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-sysconfig\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2551dd2-e285-4d75-83c0-e7937ffbf046-agent-certs\") pod \"konnectivity-agent-wqp22\" (UID: \"e2551dd2-e285-4d75-83c0-e7937ffbf046\") " pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013287 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-etc-kubernetes\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8n9r\" (UniqueName: \"kubernetes.io/projected/b8947b1d-7879-4779-8c54-dc5584fd1ad8-kube-api-access-p8n9r\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-systemd-units\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-slash\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013440 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-ovn\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.014491 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013470 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-systemd-units\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013512 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-slash\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-run-ovn\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013538 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-registration-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-cni-bin\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-cni-netd\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovnkube-config\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013665 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-host-cni-netd\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013733 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-registration-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovnkube-script-lib\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013786 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85ed711a-4175-4ddd-97c9-bb033d8c2c66-dbus\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013811 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-run\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013832 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-var-lib-kubelet\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eaa3070-fda9-4718-ba72-caf6ec05585f-tmp-dir\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013894 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lhcg\" (UniqueName: \"kubernetes.io/projected/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-kube-api-access-6lhcg\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013931 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-system-cni-dir\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.015265 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.013976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-system-cni-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014009 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014047 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-node-log\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014076 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014100 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd8bd279-995f-4049-9a68-0bebd8f32207-tmp\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-host\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014188 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-os-release\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8947b1d-7879-4779-8c54-dc5584fd1ad8-iptables-alerter-script\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-socket-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-device-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014362 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1eaa3070-fda9-4718-ba72-caf6ec05585f-hosts-file\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014396 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2551dd2-e285-4d75-83c0-e7937ffbf046-konnectivity-ca\") pod \"konnectivity-agent-wqp22\" (UID: \"e2551dd2-e285-4d75-83c0-e7937ffbf046\") " pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014394 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovnkube-config\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-multus-certs\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8947b1d-7879-4779-8c54-dc5584fd1ad8-host-slash\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014573 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8947b1d-7879-4779-8c54-dc5584fd1ad8-host-slash\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014800 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-node-log\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.016105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.014977 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85ed711a-4175-4ddd-97c9-bb033d8c2c66-dbus\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015044 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-run\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015090 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd8bd279-995f-4049-9a68-0bebd8f32207-var-lib-kubelet\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015208 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovnkube-script-lib\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015335 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-socket-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015406 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8947b1d-7879-4779-8c54-dc5584fd1ad8-iptables-alerter-script\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015408 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2763fc72-bce3-4be5-af02-dc665f4d25fb-device-dir\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.015515 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015603 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 03:45:03 +0000 UTC" deadline="2027-12-27 00:58:09.078428256 +0000 UTC" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.015653 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12645h8m5.062782963s" Jul 18 03:50:04.016876 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.015691 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:04.515656256 +0000 UTC m=+3.028023803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:04.017400 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.016972 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-ovn-node-metrics-cert\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.017946 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.017883 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd8bd279-995f-4049-9a68-0bebd8f32207-etc-tuned\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.018263 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.018218 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd8bd279-995f-4049-9a68-0bebd8f32207-tmp\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.019657 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.019636 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:04.019657 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.019657 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:04.019805 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.019669 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:04.019805 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.019730 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:04.519713581 +0000 UTC m=+3.032081100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:04.020374 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.020282 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p596\" (UniqueName: \"kubernetes.io/projected/14fcb42e-fe3b-4c93-b1c0-8959e427c3bf-kube-api-access-7p596\") pod \"ovnkube-node-tmqh8\" (UID: \"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.020869 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.020851 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f65gh\" (UniqueName: \"kubernetes.io/projected/cd8bd279-995f-4049-9a68-0bebd8f32207-kube-api-access-f65gh\") pod \"tuned-r42rz\" (UID: \"cd8bd279-995f-4049-9a68-0bebd8f32207\") " pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.021625 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.021585 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkb6\" (UniqueName: \"kubernetes.io/projected/2763fc72-bce3-4be5-af02-dc665f4d25fb-kube-api-access-nfkb6\") pod \"aws-ebs-csi-driver-node-55562\" (UID: \"2763fc72-bce3-4be5-af02-dc665f4d25fb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.021723 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.021704 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8n9r\" (UniqueName: \"kubernetes.io/projected/b8947b1d-7879-4779-8c54-dc5584fd1ad8-kube-api-access-p8n9r\") pod \"iptables-alerter-frppt\" (UID: \"b8947b1d-7879-4779-8c54-dc5584fd1ad8\") " pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.036872 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.036824 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" event={"ID":"3c580114a4f37ef1d27be9bc29b0710f","Type":"ContainerStarted","Data":"9c8c8f53e3d4332302fd65ecf08f6dce8559ea3f54ab3dfb1beb6aafe3fae702"} Jul 18 03:50:04.037861 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.037835 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" event={"ID":"64eb37ed0ac65b2b2fec0d5bd2802157","Type":"ContainerStarted","Data":"608963745a65f57fc9919693064edd73c288bbf4877c6ada38a6baccd0d90877"} Jul 18 03:50:04.114944 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.114907 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-serviceca\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.115098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.114969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/571383bd-4549-4e92-b7ad-124d82c0a842-cni-binary-copy\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.114995 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-cni-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115016 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-k8s-cni-cncf-io\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115036 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-kubelet\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115062 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-hostroot\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115087 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115112 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fl8x\" (UniqueName: \"kubernetes.io/projected/41787ee1-0ac0-4a06-a47e-9db479999abd-kube-api-access-6fl8x\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115120 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-k8s-cni-cncf-io\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzp7\" (UniqueName: \"kubernetes.io/projected/bbc8f9e0-4d62-4591-8e44-b75618f15c29-kube-api-access-wgzp7\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115136 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-hostroot\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115134 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-kubelet\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115126 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-cni-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115288 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-socket-dir-parent\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2551dd2-e285-4d75-83c0-e7937ffbf046-agent-certs\") pod \"konnectivity-agent-wqp22\" (UID: \"e2551dd2-e285-4d75-83c0-e7937ffbf046\") " pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115354 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-socket-dir-parent\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-etc-kubernetes\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-cni-bin\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eaa3070-fda9-4718-ba72-caf6ec05585f-tmp-dir\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115427 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-serviceca\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115450 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lhcg\" (UniqueName: \"kubernetes.io/projected/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-kube-api-access-6lhcg\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115453 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-etc-kubernetes\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115486 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-cni-bin\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-system-cni-dir\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115562 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-system-cni-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115587 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115599 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/571383bd-4549-4e92-b7ad-124d82c0a842-cni-binary-copy\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-host\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-os-release\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115663 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-system-cni-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1eaa3070-fda9-4718-ba72-caf6ec05585f-hosts-file\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.115692 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115701 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-system-cni-dir\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115726 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eaa3070-fda9-4718-ba72-caf6ec05585f-tmp-dir\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115693 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2551dd2-e285-4d75-83c0-e7937ffbf046-konnectivity-ca\") pod \"konnectivity-agent-wqp22\" (UID: \"e2551dd2-e285-4d75-83c0-e7937ffbf046\") " pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.115740 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115724 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.115747 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:50:04.615729947 +0000 UTC m=+3.128097483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115755 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1eaa3070-fda9-4718-ba72-caf6ec05585f-hosts-file\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115759 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-os-release\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115770 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-host\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-multus-certs\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115803 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p654q\" (UniqueName: \"kubernetes.io/projected/1eaa3070-fda9-4718-ba72-caf6ec05585f-kube-api-access-p654q\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115804 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-multus-certs\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cnibin\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-conf-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/571383bd-4549-4e92-b7ad-124d82c0a842-multus-daemon-config\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115885 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cnibin\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115888 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7c2f\" (UniqueName: \"kubernetes.io/projected/571383bd-4549-4e92-b7ad-124d82c0a842-kube-api-access-t7c2f\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-multus-conf-dir\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-cni-multus\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.115999 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cni-binary-copy\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.116588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116021 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-cnibin\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-netns\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116070 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-os-release\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116177 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-os-release\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116231 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e2551dd2-e285-4d75-83c0-e7937ffbf046-konnectivity-ca\") pod \"konnectivity-agent-wqp22\" (UID: \"e2551dd2-e285-4d75-83c0-e7937ffbf046\") " pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116246 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-cnibin\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116287 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-run-netns\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116351 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/571383bd-4549-4e92-b7ad-124d82c0a842-host-var-lib-cni-multus\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116424 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbc8f9e0-4d62-4591-8e44-b75618f15c29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116446 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/571383bd-4549-4e92-b7ad-124d82c0a842-multus-daemon-config\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.116445 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.117395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.117059 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbc8f9e0-4d62-4591-8e44-b75618f15c29-cni-binary-copy\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.118216 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.118194 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e2551dd2-e285-4d75-83c0-e7937ffbf046-agent-certs\") pod \"konnectivity-agent-wqp22\" (UID: \"e2551dd2-e285-4d75-83c0-e7937ffbf046\") " pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.123572 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.123548 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lhcg\" (UniqueName: \"kubernetes.io/projected/c8d80b34-8bef-4571-9ff3-fc5058e52f7d-kube-api-access-6lhcg\") pod \"node-ca-jrzq9\" (UID: \"c8d80b34-8bef-4571-9ff3-fc5058e52f7d\") " pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.124032 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.123980 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7c2f\" (UniqueName: \"kubernetes.io/projected/571383bd-4549-4e92-b7ad-124d82c0a842-kube-api-access-t7c2f\") pod \"multus-crbwg\" (UID: \"571383bd-4549-4e92-b7ad-124d82c0a842\") " pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.124542 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.124512 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fl8x\" (UniqueName: \"kubernetes.io/projected/41787ee1-0ac0-4a06-a47e-9db479999abd-kube-api-access-6fl8x\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:04.124991 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.124974 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p654q\" (UniqueName: \"kubernetes.io/projected/1eaa3070-fda9-4718-ba72-caf6ec05585f-kube-api-access-p654q\") pod \"node-resolver-kglbm\" (UID: \"1eaa3070-fda9-4718-ba72-caf6ec05585f\") " pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.125079 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.125003 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzp7\" (UniqueName: \"kubernetes.io/projected/bbc8f9e0-4d62-4591-8e44-b75618f15c29-kube-api-access-wgzp7\") pod \"multus-additional-cni-plugins-m4rhg\" (UID: \"bbc8f9e0-4d62-4591-8e44-b75618f15c29\") " pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.206062 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.206029 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-frppt" Jul 18 03:50:04.213733 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.213705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:04.228538 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.228516 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" Jul 18 03:50:04.235138 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.235110 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r42rz" Jul 18 03:50:04.242675 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.242658 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kglbm" Jul 18 03:50:04.251225 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.251206 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jrzq9" Jul 18 03:50:04.259662 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.259643 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:04.266151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.266134 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" Jul 18 03:50:04.271746 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.271724 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-crbwg" Jul 18 03:50:04.289471 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.289447 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:04.325211 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.325189 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 03:50:04.519710 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.519618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:04.519856 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.519751 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:04.519856 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.519826 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.519807098 +0000 UTC m=+4.032174623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:04.620743 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.620712 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:04.620743 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:04.620746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:04.621007 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.620870 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:04.621007 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.620881 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:04.621007 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.620904 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:04.621007 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.620914 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:04.621007 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.620922 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.620905427 +0000 UTC m=+4.133272947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:04.621007 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:04.620953 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:05.620942742 +0000 UTC m=+4.133310260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:04.991832 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:04.991769 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc8f9e0_4d62_4591_8e44_b75618f15c29.slice/crio-3acbb2bb222065d772cbc2350e32ad580b0aa8394b6de138c9939a1d63164901 WatchSource:0}: Error finding container 3acbb2bb222065d772cbc2350e32ad580b0aa8394b6de138c9939a1d63164901: Status 404 returned error can't find the container with id 3acbb2bb222065d772cbc2350e32ad580b0aa8394b6de138c9939a1d63164901 Jul 18 03:50:04.997272 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:04.997238 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2551dd2_e285_4d75_83c0_e7937ffbf046.slice/crio-8c336570d2fdf97d581354c76ca444485d18f6932e9ae78e9834be402b4956bd WatchSource:0}: Error finding container 8c336570d2fdf97d581354c76ca444485d18f6932e9ae78e9834be402b4956bd: Status 404 returned error can't find the container with id 8c336570d2fdf97d581354c76ca444485d18f6932e9ae78e9834be402b4956bd Jul 18 03:50:04.998478 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:04.998442 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8bd279_995f_4049_9a68_0bebd8f32207.slice/crio-16ae9514e05ea9a73375fe0698c7cbbf23e7d984ea2899909b1c4cdfb80e3438 WatchSource:0}: Error finding container 16ae9514e05ea9a73375fe0698c7cbbf23e7d984ea2899909b1c4cdfb80e3438: Status 404 returned error can't find the container with id 16ae9514e05ea9a73375fe0698c7cbbf23e7d984ea2899909b1c4cdfb80e3438 Jul 18 03:50:04.999179 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:04.999156 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d80b34_8bef_4571_9ff3_fc5058e52f7d.slice/crio-a20b45be7a580a6fb19e73ad614cafe49a7ff70c4eeb4c3af68b254094cdb02c WatchSource:0}: Error finding container a20b45be7a580a6fb19e73ad614cafe49a7ff70c4eeb4c3af68b254094cdb02c: Status 404 returned error can't find the container with id a20b45be7a580a6fb19e73ad614cafe49a7ff70c4eeb4c3af68b254094cdb02c Jul 18 03:50:04.999890 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:04.999799 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8947b1d_7879_4779_8c54_dc5584fd1ad8.slice/crio-3c5cd8e029ad111a9b0fbb655990c6ff7248cd26f20d081ce0bea9c71aa00909 WatchSource:0}: Error finding container 3c5cd8e029ad111a9b0fbb655990c6ff7248cd26f20d081ce0bea9c71aa00909: Status 404 returned error can't find the container with id 3c5cd8e029ad111a9b0fbb655990c6ff7248cd26f20d081ce0bea9c71aa00909 Jul 18 03:50:05.001411 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:05.001279 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571383bd_4549_4e92_b7ad_124d82c0a842.slice/crio-2fd452b9906bf0461006e32ba7080581b37a88bb693807a39a165869f79439dc WatchSource:0}: Error finding container 2fd452b9906bf0461006e32ba7080581b37a88bb693807a39a165869f79439dc: Status 404 returned error can't find the container with id 2fd452b9906bf0461006e32ba7080581b37a88bb693807a39a165869f79439dc Jul 18 03:50:05.003210 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:05.003094 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2763fc72_bce3_4be5_af02_dc665f4d25fb.slice/crio-c09f9260a810781eebc59ec19d6f22aa8b14e4b563d9c83420f606c0003b21a4 WatchSource:0}: Error finding container c09f9260a810781eebc59ec19d6f22aa8b14e4b563d9c83420f606c0003b21a4: Status 404 returned error can't find the container with id c09f9260a810781eebc59ec19d6f22aa8b14e4b563d9c83420f606c0003b21a4 Jul 18 03:50:05.004678 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:05.004605 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eaa3070_fda9_4718_ba72_caf6ec05585f.slice/crio-d3b6793edbc24dea5d59d16e22f5b7233480b2cfc888412b34e356ac760717bd WatchSource:0}: Error finding container d3b6793edbc24dea5d59d16e22f5b7233480b2cfc888412b34e356ac760717bd: Status 404 returned error can't find the container with id d3b6793edbc24dea5d59d16e22f5b7233480b2cfc888412b34e356ac760717bd Jul 18 03:50:05.016442 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.016401 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 03:45:03 +0000 UTC" deadline="2028-01-13 16:00:44.099963642 +0000 UTC" Jul 18 03:50:05.016442 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.016440 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13068h10m39.083525712s" Jul 18 03:50:05.031345 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.031325 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:05.031419 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.031335 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:05.031456 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.031422 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:05.031490 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.031477 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:05.041906 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.041878 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kglbm" event={"ID":"1eaa3070-fda9-4718-ba72-caf6ec05585f","Type":"ContainerStarted","Data":"d3b6793edbc24dea5d59d16e22f5b7233480b2cfc888412b34e356ac760717bd"} Jul 18 03:50:05.043579 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.043559 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" event={"ID":"2763fc72-bce3-4be5-af02-dc665f4d25fb","Type":"ContainerStarted","Data":"c09f9260a810781eebc59ec19d6f22aa8b14e4b563d9c83420f606c0003b21a4"} Jul 18 03:50:05.044565 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.044545 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crbwg" event={"ID":"571383bd-4549-4e92-b7ad-124d82c0a842","Type":"ContainerStarted","Data":"2fd452b9906bf0461006e32ba7080581b37a88bb693807a39a165869f79439dc"} Jul 18 03:50:05.045576 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.045556 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jrzq9" event={"ID":"c8d80b34-8bef-4571-9ff3-fc5058e52f7d","Type":"ContainerStarted","Data":"a20b45be7a580a6fb19e73ad614cafe49a7ff70c4eeb4c3af68b254094cdb02c"} Jul 18 03:50:05.046685 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.046664 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqp22" event={"ID":"e2551dd2-e285-4d75-83c0-e7937ffbf046","Type":"ContainerStarted","Data":"8c336570d2fdf97d581354c76ca444485d18f6932e9ae78e9834be402b4956bd"} Jul 18 03:50:05.052335 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.052310 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerStarted","Data":"3acbb2bb222065d772cbc2350e32ad580b0aa8394b6de138c9939a1d63164901"} Jul 18 03:50:05.055621 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.055601 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-frppt" event={"ID":"b8947b1d-7879-4779-8c54-dc5584fd1ad8","Type":"ContainerStarted","Data":"3c5cd8e029ad111a9b0fbb655990c6ff7248cd26f20d081ce0bea9c71aa00909"} Jul 18 03:50:05.056716 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.056696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r42rz" event={"ID":"cd8bd279-995f-4049-9a68-0bebd8f32207","Type":"ContainerStarted","Data":"16ae9514e05ea9a73375fe0698c7cbbf23e7d984ea2899909b1c4cdfb80e3438"} Jul 18 03:50:05.057711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.057692 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"37848f8121ed6fd95e3927c0ecfe0e82acb2adf4e3c75efed39c23a273fd6cc4"} Jul 18 03:50:05.528028 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.527155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:05.528028 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.527572 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:05.528028 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.527636 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:07.527616371 +0000 UTC m=+6.039983904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.628080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:05.628131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.628324 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.628382 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:50:07.628363209 +0000 UTC m=+6.140730744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.628767 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.628787 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.628800 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:05.628875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:05.628843 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:07.628827169 +0000 UTC m=+6.141194696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:06.032506 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:06.032479 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:06.032875 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:06.032626 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:06.074729 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:06.074694 2583 generic.go:356] "Generic (PLEG): container finished" podID="3c580114a4f37ef1d27be9bc29b0710f" containerID="a6035266ba18309054e669a9f6c578eff6934a3929683f76ece1df7ec4959f29" exitCode=0 Jul 18 03:50:06.074881 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:06.074787 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" event={"ID":"3c580114a4f37ef1d27be9bc29b0710f","Type":"ContainerDied","Data":"a6035266ba18309054e669a9f6c578eff6934a3929683f76ece1df7ec4959f29"} Jul 18 03:50:06.084583 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:06.084086 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" event={"ID":"64eb37ed0ac65b2b2fec0d5bd2802157","Type":"ContainerStarted","Data":"ce173e03accb7377e1d7aaa59ae6c4a0b143f9a1ec22fe295e4a329fc6073095"} Jul 18 03:50:07.031366 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.031257 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:07.031528 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.031400 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:07.031592 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.031524 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:07.031664 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.031627 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:07.111596 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.111398 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" event={"ID":"3c580114a4f37ef1d27be9bc29b0710f","Type":"ContainerStarted","Data":"526073223e5cd1245c8d24109bb9e934381afc625e53b84c52a5566008f65bbb"} Jul 18 03:50:07.125943 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.125223 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-144.ec2.internal" podStartSLOduration=5.125203569 podStartE2EDuration="5.125203569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:06.101455769 +0000 UTC m=+4.613823327" watchObservedRunningTime="2026-07-18 03:50:07.125203569 +0000 UTC m=+5.637571112" Jul 18 03:50:07.547272 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.547227 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:07.547465 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.547415 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:07.547527 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.547477 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:11.547458996 +0000 UTC m=+10.059826530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:07.648587 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.648518 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:07.648587 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:07.648564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:07.648817 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.648712 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:07.648817 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.648770 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:50:11.64875178 +0000 UTC m=+10.161119305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:07.649212 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.649162 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:07.649212 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.649181 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:07.649212 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.649198 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:07.649429 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:07.649241 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:11.649225237 +0000 UTC m=+10.161592759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:08.031374 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:08.031280 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:08.031532 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:08.031446 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:09.031538 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:09.031497 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:09.031994 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:09.031551 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:09.031994 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:09.031638 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:09.031994 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:09.031720 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:10.032334 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:10.032247 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:10.032848 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:10.032411 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:11.031799 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:11.031765 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:11.031799 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:11.031799 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:11.032003 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.031892 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:11.032003 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.031993 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:11.585408 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:11.585072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:11.585408 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.585247 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:11.585408 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.585333 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:19.585314351 +0000 UTC m=+18.097681885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:11.685646 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:11.685598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:11.685830 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:11.685663 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:11.685830 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.685798 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:11.685940 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.685859 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:50:19.685841049 +0000 UTC m=+18.198208583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:11.686303 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.686281 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:11.686408 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.686324 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:11.686408 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.686336 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:11.686408 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:11.686378 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:19.686364775 +0000 UTC m=+18.198732308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:12.032983 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:12.032891 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:12.033317 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:12.033272 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:13.031969 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:13.031936 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:13.032457 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:13.032074 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:13.032457 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:13.032446 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:13.032625 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:13.032537 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:14.032307 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:14.032271 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:14.032795 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:14.032430 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:15.031471 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:15.031439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:15.031471 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:15.031475 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:15.031687 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:15.031556 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:15.031687 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:15.031667 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:16.031509 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:16.031479 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:16.031928 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:16.031609 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:17.031419 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:17.031382 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:17.031582 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:17.031511 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:17.031582 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:17.031568 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:17.031985 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:17.031674 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:18.032186 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:18.032142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:18.032632 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:18.032277 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:19.031163 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:19.031131 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:19.031163 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:19.031154 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:19.031443 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.031244 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:19.031443 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.031391 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:19.646909 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:19.646873 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:19.647321 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.646976 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:19.647321 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.647048 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:50:35.647027678 +0000 UTC m=+34.159395201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:19.747437 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:19.747403 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:19.747607 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:19.747443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:19.747607 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.747572 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:19.747690 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.747627 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:50:35.74761247 +0000 UTC m=+34.259979989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:19.747690 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.747575 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:19.747690 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.747670 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:19.747690 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.747680 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:19.747852 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:19.747726 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:35.747709882 +0000 UTC m=+34.260077416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:20.031901 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:20.031821 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:20.032070 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:20.031961 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:21.031426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:21.031394 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:21.031854 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:21.031521 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:21.031854 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:21.031568 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:21.031854 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:21.031672 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:22.032796 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:22.032749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:22.033237 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:22.033051 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:23.031753 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:23.031722 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:23.031913 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:23.031728 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:23.031913 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:23.031829 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:23.032033 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:23.031917 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:24.031718 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.031525 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:24.032695 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:24.031834 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:24.147560 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.147458 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kglbm" event={"ID":"1eaa3070-fda9-4718-ba72-caf6ec05585f","Type":"ContainerStarted","Data":"6a89e98e20733c41c04483acb4669ac2fa86c547a87c38345c22de633e063526"} Jul 18 03:50:24.149037 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.149009 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" event={"ID":"2763fc72-bce3-4be5-af02-dc665f4d25fb","Type":"ContainerStarted","Data":"f03904d44900ef84b2becc39ef2e5a6c133e774b06ff816843f6af46226eb65f"} Jul 18 03:50:24.150261 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.150235 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-crbwg" event={"ID":"571383bd-4549-4e92-b7ad-124d82c0a842","Type":"ContainerStarted","Data":"ea24de5711b477f0cec224e4b6ae2418e0d592d8e809cc9537518fbf697a68b4"} Jul 18 03:50:24.151588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.151567 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jrzq9" event={"ID":"c8d80b34-8bef-4571-9ff3-fc5058e52f7d","Type":"ContainerStarted","Data":"771cd192cda06869080b5a2be7a79c4b61a44d8bb0ea0725c841b2d4f2d44f89"} Jul 18 03:50:24.152780 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.152752 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqp22" event={"ID":"e2551dd2-e285-4d75-83c0-e7937ffbf046","Type":"ContainerStarted","Data":"66463db8f0f49b6aba62ad0f1d3fd3fdc0f1f935409ec3751bab6778a4748556"} Jul 18 03:50:24.154046 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.154023 2583 generic.go:356] "Generic (PLEG): container finished" podID="bbc8f9e0-4d62-4591-8e44-b75618f15c29" containerID="e873f18049be7e7774d6eb17cdaba2364bc9ca57b6b9d2c7e6796e88784cdfa6" exitCode=0 Jul 18 03:50:24.154134 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.154100 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerDied","Data":"e873f18049be7e7774d6eb17cdaba2364bc9ca57b6b9d2c7e6796e88784cdfa6"} Jul 18 03:50:24.155521 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.155504 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r42rz" event={"ID":"cd8bd279-995f-4049-9a68-0bebd8f32207","Type":"ContainerStarted","Data":"76a81f63fa05ad354a4b9c47dbe01b961a8ddbe74eb3e8703edfc63a20f2174f"} Jul 18 03:50:24.158320 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.158281 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"17de1c767e914e49c6891a8af9f7ff2d36746abb98e32e8c65ac58b1600a625b"} Jul 18 03:50:24.158400 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.158361 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"7720a0bfb55fe60af640c8f433f19bef4da2d25728a706d682f3e6e117b912a5"} Jul 18 03:50:24.158441 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.158397 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"29648e4a7e009abbad8c7ce2d273a14587875de9c19ba540c9693441907a9b92"} Jul 18 03:50:24.158441 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.158429 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"d73f691f35a16f02f7a1f64e410c97b84795f92bd1261878aae442208e36879f"} Jul 18 03:50:24.158499 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.158456 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"d86c6b2f2581041a1e73a3d5d3c3018455f3120076447a2dc6137be0d444279f"} Jul 18 03:50:24.158499 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.158489 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"80d26c25711064f5e6585ffadf7b9eb13a32101a94bb555f39211d9ade5ed469"} Jul 18 03:50:24.162264 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.162196 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kglbm" podStartSLOduration=3.750553409 podStartE2EDuration="22.162184003s" totalImagesPullingTime="18.411630594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:24.161714063 +0000 UTC m=+22.674081603" watchObservedRunningTime="2026-07-18 03:50:24.162184003 +0000 UTC m=+22.674551544" Jul 18 03:50:24.162364 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.162318 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-144.ec2.internal" podStartSLOduration=22.162294144 podStartE2EDuration="22.162294144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:07.126269081 +0000 UTC m=+5.638636625" watchObservedRunningTime="2026-07-18 03:50:24.162294144 +0000 UTC m=+22.674661684" Jul 18 03:50:24.189211 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.189174 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqp22" podStartSLOduration=11.79727804 podStartE2EDuration="22.18916302s" totalImagesPullingTime="10.39188498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:24.174140013 +0000 UTC m=+22.686507553" watchObservedRunningTime="2026-07-18 03:50:24.18916302 +0000 UTC m=+22.701530573" Jul 18 03:50:24.189321 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.189291 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-crbwg" podStartSLOduration=3.71751145 podStartE2EDuration="22.189285959s" totalImagesPullingTime="18.471774509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:24.18868938 +0000 UTC m=+22.701056920" watchObservedRunningTime="2026-07-18 03:50:24.189285959 +0000 UTC m=+22.701653499" Jul 18 03:50:24.203151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.203114 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r42rz" podStartSLOduration=3.783869805 podStartE2EDuration="22.203103369s" totalImagesPullingTime="18.419233564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:24.202243206 +0000 UTC m=+22.714610746" watchObservedRunningTime="2026-07-18 03:50:24.203103369 +0000 UTC m=+22.715470910" Jul 18 03:50:24.216331 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.216279 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jrzq9" podStartSLOduration=3.799472547 podStartE2EDuration="22.216268719s" totalImagesPullingTime="18.416796172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:24.216078522 +0000 UTC m=+22.728446054" watchObservedRunningTime="2026-07-18 03:50:24.216268719 +0000 UTC m=+22.728636260" Jul 18 03:50:24.722312 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.722260 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:24.722848 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.722826 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:24.834606 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:24.834568 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 03:50:25.018487 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.018332 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T03:50:24.834587352Z","UUID":"167bb19f-1980-4779-93e9-e71e1872ebdb","Handler":null,"Name":"","Endpoint":""} Jul 18 03:50:25.019915 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.019892 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 03:50:25.020106 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.019928 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 03:50:25.031600 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.031579 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:25.031750 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.031579 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:25.031750 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:25.031680 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:25.032119 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:25.031804 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:25.163288 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.163251 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" event={"ID":"2763fc72-bce3-4be5-af02-dc665f4d25fb","Type":"ContainerStarted","Data":"d01ff8d294f8f0038833c927b53635aabadce41c38bef2057439118da0ed931e"} Jul 18 03:50:25.164910 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.164871 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-frppt" event={"ID":"b8947b1d-7879-4779-8c54-dc5584fd1ad8","Type":"ContainerStarted","Data":"91e5fa51f5e94c2662e74744204b533f360385d1d67832e70f2076ee8aa83baf"} Jul 18 03:50:25.165820 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.165797 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:25.165950 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.165860 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqp22" Jul 18 03:50:25.178963 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:25.178910 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-frppt" podStartSLOduration=4.76325253 podStartE2EDuration="23.178896993s" totalImagesPullingTime="18.415644463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:25.178290804 +0000 UTC m=+23.690658344" watchObservedRunningTime="2026-07-18 03:50:25.178896993 +0000 UTC m=+23.691264550" Jul 18 03:50:26.032257 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:26.032233 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:26.032668 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:26.032367 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:26.170642 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:26.170400 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" event={"ID":"2763fc72-bce3-4be5-af02-dc665f4d25fb","Type":"ContainerStarted","Data":"abf8d223f20a9df6898d3a9818d03443d33612574529904403228ea6ee3424a1"} Jul 18 03:50:26.177511 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:26.175822 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"a2ac51004ded240e948a82552b9cc68c7cf0cb8c9d1bf81250de4ecb967cc19a"} Jul 18 03:50:26.187031 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:26.186985 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-55562" podStartSLOduration=3.553737256 podStartE2EDuration="24.186968395s" totalImagesPullingTime="20.633231139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:26.186365632 +0000 UTC m=+24.698733194" watchObservedRunningTime="2026-07-18 03:50:26.186968395 +0000 UTC m=+24.699335936" Jul 18 03:50:27.031347 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:27.031319 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:27.031563 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:27.031381 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:27.031563 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:27.031435 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:27.031563 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:27.031479 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:28.031617 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:28.031582 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:28.032084 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:28.031720 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:29.031702 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.031486 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:29.032396 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.031544 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:29.032396 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:29.031751 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:29.032396 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:29.031806 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:29.185172 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.185136 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" event={"ID":"14fcb42e-fe3b-4c93-b1c0-8959e427c3bf","Type":"ContainerStarted","Data":"b2ee7f262034f539906be570344ba6196d1df8796dcf94faf87673b8a0f7fda6"} Jul 18 03:50:29.185402 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.185387 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:29.187099 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.187070 2583 generic.go:356] "Generic (PLEG): container finished" podID="bbc8f9e0-4d62-4591-8e44-b75618f15c29" containerID="a0bb5db9873cfc6a445191b3ce043bd97392a7d41659999537cccce5159fc501" exitCode=0 Jul 18 03:50:29.187099 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.187101 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerDied","Data":"a0bb5db9873cfc6a445191b3ce043bd97392a7d41659999537cccce5159fc501"} Jul 18 03:50:29.201480 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.201393 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:29.209367 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:29.209324 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" podStartSLOduration=8.724441771 podStartE2EDuration="27.209312422s" totalImagesPullingTime="18.484870651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:29.209029991 +0000 UTC m=+27.721397543" watchObservedRunningTime="2026-07-18 03:50:29.209312422 +0000 UTC m=+27.721679957" Jul 18 03:50:30.031411 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.031383 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:30.031709 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:30.031514 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:30.189211 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.189179 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:30.189378 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.189253 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:30.205166 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.205144 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:50:30.309020 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.308795 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mkj45"] Jul 18 03:50:30.309141 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.309080 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:30.309189 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:30.309172 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:30.312277 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.312252 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8f6tt"] Jul 18 03:50:30.312395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.312384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:30.312532 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:30.312508 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:30.312783 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.312765 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gdzq9"] Jul 18 03:50:30.312862 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:30.312849 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:30.312971 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:30.312951 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:31.193067 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:31.193035 2583 generic.go:356] "Generic (PLEG): container finished" podID="bbc8f9e0-4d62-4591-8e44-b75618f15c29" containerID="eb75470e2ba775b42349bcd2a8a6b732d537a7e0c7090799178ce4a060a82e57" exitCode=0 Jul 18 03:50:31.193554 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:31.193114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerDied","Data":"eb75470e2ba775b42349bcd2a8a6b732d537a7e0c7090799178ce4a060a82e57"} Jul 18 03:50:32.032334 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:32.032288 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:32.032457 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:32.032392 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:32.032497 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:32.032480 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:32.032599 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:32.032580 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:32.032649 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:32.032637 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:32.032757 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:32.032740 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:33.199438 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:33.199360 2583 generic.go:356] "Generic (PLEG): container finished" podID="bbc8f9e0-4d62-4591-8e44-b75618f15c29" containerID="9d5c8d6b2dc9c63d8bcfc25c20af774d9d245372ea3a2c29b7055248f73c4440" exitCode=0 Jul 18 03:50:33.199438 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:33.199417 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerDied","Data":"9d5c8d6b2dc9c63d8bcfc25c20af774d9d245372ea3a2c29b7055248f73c4440"} Jul 18 03:50:34.031886 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:34.031853 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:34.032094 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:34.032024 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:34.032230 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:34.032200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:34.032480 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:34.032212 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:34.032480 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:34.032331 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:34.032480 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:34.032444 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:35.675217 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:35.675179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:35.675619 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.675359 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:35.675619 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.675424 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret podName:85ed711a-4175-4ddd-97c9-bb033d8c2c66 nodeName:}" failed. No retries permitted until 2026-07-18 03:51:07.675406421 +0000 UTC m=+66.187773943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret") pod "global-pull-secret-syncer-mkj45" (UID: "85ed711a-4175-4ddd-97c9-bb033d8c2c66") : object "kube-system"/"original-pull-secret" not registered Jul 18 03:50:35.775919 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:35.775888 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:35.775919 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:35.775923 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:35.776142 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.776043 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:35.776142 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.776059 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 03:50:35.776142 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.776078 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 03:50:35.776142 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.776091 2583 projected.go:196] Error preparing data for projected volume kube-api-access-cglgt for pod openshift-network-diagnostics/network-check-target-8f6tt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:35.776142 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.776108 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:51:07.776088284 +0000 UTC m=+66.288455805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 03:50:35.776142 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:35.776138 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt podName:65921a36-21c3-4d7d-940c-c53cbd0f714b nodeName:}" failed. No retries permitted until 2026-07-18 03:51:07.776128456 +0000 UTC m=+66.288495978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cglgt" (UniqueName: "kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt") pod "network-check-target-8f6tt" (UID: "65921a36-21c3-4d7d-940c-c53cbd0f714b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 03:50:36.031780 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:36.031696 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:36.031928 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:36.031696 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:36.031928 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:36.031821 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8f6tt" podUID="65921a36-21c3-4d7d-940c-c53cbd0f714b" Jul 18 03:50:36.031928 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:36.031696 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:36.031928 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:36.031900 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:50:36.032140 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:36.031956 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mkj45" podUID="85ed711a-4175-4ddd-97c9-bb033d8c2c66" Jul 18 03:50:37.201922 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.201901 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-144.ec2.internal" event="NodeReady" Jul 18 03:50:37.202223 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.202020 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 03:50:37.239799 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.239774 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7887m"] Jul 18 03:50:37.242590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.242568 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gqx9d"] Jul 18 03:50:37.242728 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.242672 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.245292 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.245271 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.245416 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.245371 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 03:50:37.245862 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.245843 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 03:50:37.245937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.245888 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rnqn\"" Jul 18 03:50:37.247206 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.247186 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 03:50:37.247206 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.247189 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 03:50:37.247499 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.247420 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 03:50:37.247579 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.247520 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm4kf\"" Jul 18 03:50:37.252396 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.252374 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7887m"] Jul 18 03:50:37.255596 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.255292 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gqx9d"] Jul 18 03:50:37.286109 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.286070 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4bc9e1e-384b-4ea9-a4a7-891a4f971b50-cert\") pod \"ingress-canary-gqx9d\" (UID: \"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50\") " pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.286254 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.286161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49275967-d1a5-417e-a356-b4a6d853337b-config-volume\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.286254 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.286218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8cb\" (UniqueName: \"kubernetes.io/projected/49275967-d1a5-417e-a356-b4a6d853337b-kube-api-access-xb8cb\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.286357 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.286287 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqgzq\" (UniqueName: \"kubernetes.io/projected/b4bc9e1e-384b-4ea9-a4a7-891a4f971b50-kube-api-access-rqgzq\") pod \"ingress-canary-gqx9d\" (UID: \"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50\") " pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.286357 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.286341 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.286428 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.286368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49275967-d1a5-417e-a356-b4a6d853337b-tmp-dir\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.387547 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49275967-d1a5-417e-a356-b4a6d853337b-config-volume\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.387663 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387566 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8cb\" (UniqueName: \"kubernetes.io/projected/49275967-d1a5-417e-a356-b4a6d853337b-kube-api-access-xb8cb\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.387663 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqgzq\" (UniqueName: \"kubernetes.io/projected/b4bc9e1e-384b-4ea9-a4a7-891a4f971b50-kube-api-access-rqgzq\") pod \"ingress-canary-gqx9d\" (UID: \"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50\") " pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.387663 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.387663 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49275967-d1a5-417e-a356-b4a6d853337b-tmp-dir\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.387663 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387657 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4bc9e1e-384b-4ea9-a4a7-891a4f971b50-cert\") pod \"ingress-canary-gqx9d\" (UID: \"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50\") " pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.387884 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:37.387712 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:37.387884 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:37.387782 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:37.887762279 +0000 UTC m=+36.400129813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:50:37.387967 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.387949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49275967-d1a5-417e-a356-b4a6d853337b-tmp-dir\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.388148 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.388130 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49275967-d1a5-417e-a356-b4a6d853337b-config-volume\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.391852 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.391831 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4bc9e1e-384b-4ea9-a4a7-891a4f971b50-cert\") pod \"ingress-canary-gqx9d\" (UID: \"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50\") " pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.397586 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.397564 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8cb\" (UniqueName: \"kubernetes.io/projected/49275967-d1a5-417e-a356-b4a6d853337b-kube-api-access-xb8cb\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.397586 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.397572 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqgzq\" (UniqueName: \"kubernetes.io/projected/b4bc9e1e-384b-4ea9-a4a7-891a4f971b50-kube-api-access-rqgzq\") pod \"ingress-canary-gqx9d\" (UID: \"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50\") " pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.558865 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.558771 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gqx9d" Jul 18 03:50:37.682675 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.682646 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gqx9d"] Jul 18 03:50:37.686035 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:50:37.686014 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bc9e1e_384b_4ea9_a4a7_891a4f971b50.slice/crio-c8e2a1daba1a1840e88b3d5450b636eabcb59a1e27d95b8a7ae14f9132e949b9 WatchSource:0}: Error finding container c8e2a1daba1a1840e88b3d5450b636eabcb59a1e27d95b8a7ae14f9132e949b9: Status 404 returned error can't find the container with id c8e2a1daba1a1840e88b3d5450b636eabcb59a1e27d95b8a7ae14f9132e949b9 Jul 18 03:50:37.892269 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:37.892191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:37.892433 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:37.892315 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:37.892433 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:37.892374 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:38.89235702 +0000 UTC m=+37.404724546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:50:38.031163 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.031133 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:50:38.031366 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.031133 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:50:38.031366 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.031140 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:50:38.035187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.033719 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 03:50:38.035187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.033827 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 03:50:38.035187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.033961 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 03:50:38.035187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.034438 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 03:50:38.035187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.034693 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mc9fd\"" Jul 18 03:50:38.035187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.034970 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4mng\"" Jul 18 03:50:38.215469 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.215433 2583 generic.go:356] "Generic (PLEG): container finished" podID="bbc8f9e0-4d62-4591-8e44-b75618f15c29" containerID="4a15ab474376bc56d122ee5b03bd8860ae686a8125d412441c91f086caf27b71" exitCode=0 Jul 18 03:50:38.215844 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.215480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerDied","Data":"4a15ab474376bc56d122ee5b03bd8860ae686a8125d412441c91f086caf27b71"} Jul 18 03:50:38.217635 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.217610 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gqx9d" event={"ID":"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50","Type":"ContainerStarted","Data":"c8e2a1daba1a1840e88b3d5450b636eabcb59a1e27d95b8a7ae14f9132e949b9"} Jul 18 03:50:38.900312 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:38.900050 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:38.900474 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:38.900204 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:38.900474 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:38.900388 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:40.900364881 +0000 UTC m=+39.412732401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:50:39.223592 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:39.223559 2583 generic.go:356] "Generic (PLEG): container finished" podID="bbc8f9e0-4d62-4591-8e44-b75618f15c29" containerID="dccdc8f0a39dc2f5b4584077f8037aaf1b027db7f39a47c97ef5a8e9a635e341" exitCode=0 Jul 18 03:50:39.224031 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:39.223609 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerDied","Data":"dccdc8f0a39dc2f5b4584077f8037aaf1b027db7f39a47c97ef5a8e9a635e341"} Jul 18 03:50:40.229538 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:40.229508 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" event={"ID":"bbc8f9e0-4d62-4591-8e44-b75618f15c29","Type":"ContainerStarted","Data":"adabacc99a0a499ea0a67a184224b3f746a0974acec48928abe2e60ae1c2dd55"} Jul 18 03:50:40.251027 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:40.250979 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m4rhg" podStartSLOduration=14.003254666 podStartE2EDuration="38.250963335s" totalImagesPullingTime="24.247708669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:40.249139487 +0000 UTC m=+38.761507028" watchObservedRunningTime="2026-07-18 03:50:40.250963335 +0000 UTC m=+38.763330875" Jul 18 03:50:40.915168 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:40.915132 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:40.915337 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:40.915278 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:40.915402 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:40.915373 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:44.915356542 +0000 UTC m=+43.427724061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:50:41.233585 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:41.233502 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gqx9d" event={"ID":"b4bc9e1e-384b-4ea9-a4a7-891a4f971b50","Type":"ContainerStarted","Data":"168f9688f53bcd385916b61c301f49ef52177a5e1bd0b60f706bc84c76023dfe"} Jul 18 03:50:41.251893 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:41.251846 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gqx9d" podStartSLOduration=1.782964682 podStartE2EDuration="4.251832777s" totalImagesPullingTime="2.468868095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:50:41.25050786 +0000 UTC m=+39.762875400" watchObservedRunningTime="2026-07-18 03:50:41.251832777 +0000 UTC m=+39.764200345" Jul 18 03:50:44.941590 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:44.941554 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:44.941971 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:44.941672 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:44.941971 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:44.941724 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:50:52.941711093 +0000 UTC m=+51.454078612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:50:52.997401 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:50:52.997354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:50:52.998004 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:52.997488 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:50:52.998004 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:50:52.997576 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:51:08.997553091 +0000 UTC m=+67.509920631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:51:02.214350 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:02.214321 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmqh8" Jul 18 03:51:07.697098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.697038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:51:07.699629 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.699606 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 03:51:07.710447 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.710425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85ed711a-4175-4ddd-97c9-bb033d8c2c66-original-pull-secret\") pod \"global-pull-secret-syncer-mkj45\" (UID: \"85ed711a-4175-4ddd-97c9-bb033d8c2c66\") " pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:51:07.744523 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.744495 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mkj45" Jul 18 03:51:07.799013 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.798064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:51:07.799013 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.798115 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:51:07.805903 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.805477 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 03:51:07.805903 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.805750 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 03:51:07.809397 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:51:07.809085 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 03:51:07.809397 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:51:07.809157 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:52:11.809136555 +0000 UTC m=+130.321504081 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : secret "metrics-daemon-secret" not found Jul 18 03:51:07.814730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.814523 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 03:51:07.827092 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.827040 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cglgt\" (UniqueName: \"kubernetes.io/projected/65921a36-21c3-4d7d-940c-c53cbd0f714b-kube-api-access-cglgt\") pod \"network-check-target-8f6tt\" (UID: \"65921a36-21c3-4d7d-940c-c53cbd0f714b\") " pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:51:07.876384 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:07.876353 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mkj45"] Jul 18 03:51:07.879648 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:51:07.879621 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ed711a_4175_4ddd_97c9_bb033d8c2c66.slice/crio-a915cce230035a2e0655c42fad4d1020d985a70d8462d79c4bd563b34ddc6e78 WatchSource:0}: Error finding container a915cce230035a2e0655c42fad4d1020d985a70d8462d79c4bd563b34ddc6e78: Status 404 returned error can't find the container with id a915cce230035a2e0655c42fad4d1020d985a70d8462d79c4bd563b34ddc6e78 Jul 18 03:51:08.051588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:08.051502 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mc9fd\"" Jul 18 03:51:08.060262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:08.060238 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:51:08.181227 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:08.181178 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8f6tt"] Jul 18 03:51:08.187657 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:51:08.187630 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65921a36_21c3_4d7d_940c_c53cbd0f714b.slice/crio-a67608b40821a0e9b5e2abb674ec04ef6aacdacc283779a2a807aa467e46af7d WatchSource:0}: Error finding container a67608b40821a0e9b5e2abb674ec04ef6aacdacc283779a2a807aa467e46af7d: Status 404 returned error can't find the container with id a67608b40821a0e9b5e2abb674ec04ef6aacdacc283779a2a807aa467e46af7d Jul 18 03:51:08.296365 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:08.296329 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8f6tt" event={"ID":"65921a36-21c3-4d7d-940c-c53cbd0f714b","Type":"ContainerStarted","Data":"a67608b40821a0e9b5e2abb674ec04ef6aacdacc283779a2a807aa467e46af7d"} Jul 18 03:51:08.297653 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:08.297611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mkj45" event={"ID":"85ed711a-4175-4ddd-97c9-bb033d8c2c66","Type":"ContainerStarted","Data":"a915cce230035a2e0655c42fad4d1020d985a70d8462d79c4bd563b34ddc6e78"} Jul 18 03:51:09.008196 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:09.008159 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:51:09.008676 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:51:09.008351 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:51:09.008676 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:51:09.008427 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:51:41.008410549 +0000 UTC m=+99.520778069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:51:13.311797 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:13.311757 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8f6tt" event={"ID":"65921a36-21c3-4d7d-940c-c53cbd0f714b","Type":"ContainerStarted","Data":"e2ff3571c6f4ea533a3425a0347bd20203ff8b3fd6fdbc0f828f5a8637b8b759"} Jul 18 03:51:13.312361 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:13.311842 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:51:13.313205 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:13.313182 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mkj45" event={"ID":"85ed711a-4175-4ddd-97c9-bb033d8c2c66","Type":"ContainerStarted","Data":"340cf6a5d50dcdec0a7ad9d8953270fd4abf6d6107a61b8607320339f4ea5ee8"} Jul 18 03:51:13.324352 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:13.324293 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8f6tt" podStartSLOduration=66.923877783 podStartE2EDuration="1m11.324277408s" totalImagesPullingTime="4.400399625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:13.324183611 +0000 UTC m=+71.836551167" watchObservedRunningTime="2026-07-18 03:51:13.324277408 +0000 UTC m=+71.836644949" Jul 18 03:51:13.336586 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:13.336540 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mkj45" podStartSLOduration=66.623112477 podStartE2EDuration="1m11.336525278s" totalImagesPullingTime="4.713412801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:13.336262162 +0000 UTC m=+71.848629703" watchObservedRunningTime="2026-07-18 03:51:13.336525278 +0000 UTC m=+71.848892821" Jul 18 03:51:41.016435 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:41.016403 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:51:41.016864 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:51:41.016520 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:51:41.016864 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:51:41.016581 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:52:45.016568053 +0000 UTC m=+163.528935573 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:51:44.320083 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:44.320052 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8f6tt" Jul 18 03:51:52.665579 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.665540 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7"] Jul 18 03:51:52.668118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.668103 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.670557 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.670527 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 18 03:51:52.670721 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.670589 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 18 03:51:52.670848 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.670631 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 18 03:51:52.671443 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.671425 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 18 03:51:52.676791 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.676772 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7"] Jul 18 03:51:52.793130 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.793095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7rq\" (UniqueName: \"kubernetes.io/projected/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-kube-api-access-dk7rq\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.793317 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.793149 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.793317 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.793193 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-tmp\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.894384 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.894357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7rq\" (UniqueName: \"kubernetes.io/projected/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-kube-api-access-dk7rq\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.894503 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.894399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.894503 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.894424 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-tmp\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.894825 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.894804 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-tmp\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.896782 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.896760 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-klusterlet-config\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.901269 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.901248 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7rq\" (UniqueName: \"kubernetes.io/projected/9c05fae8-ab83-4357-b4eb-446e2dfde6f0-kube-api-access-dk7rq\") pod \"klusterlet-addon-workmgr-856997c787-h4fz7\" (UID: \"9c05fae8-ab83-4357-b4eb-446e2dfde6f0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:52.977172 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:52.977111 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:53.098206 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:53.098048 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7"] Jul 18 03:51:53.100551 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:51:53.100528 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c05fae8_ab83_4357_b4eb_446e2dfde6f0.slice/crio-c40ca678307b9d9b1f3dc1920bc1093abe1e320b621b446a43738d7f26cdf0fb WatchSource:0}: Error finding container c40ca678307b9d9b1f3dc1920bc1093abe1e320b621b446a43738d7f26cdf0fb: Status 404 returned error can't find the container with id c40ca678307b9d9b1f3dc1920bc1093abe1e320b621b446a43738d7f26cdf0fb Jul 18 03:51:53.407607 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:53.407569 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" event={"ID":"9c05fae8-ab83-4357-b4eb-446e2dfde6f0","Type":"ContainerStarted","Data":"c40ca678307b9d9b1f3dc1920bc1093abe1e320b621b446a43738d7f26cdf0fb"} Jul 18 03:51:57.419800 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:57.419754 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" event={"ID":"9c05fae8-ab83-4357-b4eb-446e2dfde6f0","Type":"ContainerStarted","Data":"8a84c3869e0f2478030da30c8bdb089f8b616236440b13e014620425fbf2d817"} Jul 18 03:51:57.420191 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:57.419974 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:57.421522 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:57.421505 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:51:57.433797 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:51:57.433756 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" podStartSLOduration=1.683096048 podStartE2EDuration="5.433736727s" totalImagesPullingTime="3.750640679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:51:57.432501027 +0000 UTC m=+115.944868577" watchObservedRunningTime="2026-07-18 03:51:57.433736727 +0000 UTC m=+115.946104267" Jul 18 03:52:11.822271 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:52:11.822225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:52:11.822795 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:52:11.822365 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 03:52:11.822795 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:52:11.822418 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:54:13.822405622 +0000 UTC m=+252.334773141 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : secret "metrics-daemon-secret" not found Jul 18 03:52:40.254274 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:52:40.254214 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7887m" podUID="49275967-d1a5-417e-a356-b4a6d853337b" Jul 18 03:52:40.517676 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:52:40.517580 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7887m" Jul 18 03:52:41.054175 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:52:41.054132 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:52:45.034542 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:52:45.034498 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:52:45.035069 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:52:45.034659 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 03:52:45.035069 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:52:45.034749 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls podName:49275967-d1a5-417e-a356-b4a6d853337b nodeName:}" failed. No retries permitted until 2026-07-18 03:54:47.034719956 +0000 UTC m=+285.547087478 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls") pod "dns-default-7887m" (UID: "49275967-d1a5-417e-a356-b4a6d853337b") : secret "dns-default-metrics-tls" not found Jul 18 03:52:55.031436 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:52:55.031352 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:53:57.420271 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:57.420232 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" podUID="9c05fae8-ab83-4357-b4eb-446e2dfde6f0" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jul 18 03:53:57.700512 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:57.700432 2583 generic.go:356] "Generic (PLEG): container finished" podID="9c05fae8-ab83-4357-b4eb-446e2dfde6f0" containerID="8a84c3869e0f2478030da30c8bdb089f8b616236440b13e014620425fbf2d817" exitCode=1 Jul 18 03:53:57.700512 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:57.700484 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" event={"ID":"9c05fae8-ab83-4357-b4eb-446e2dfde6f0","Type":"ContainerDied","Data":"8a84c3869e0f2478030da30c8bdb089f8b616236440b13e014620425fbf2d817"} Jul 18 03:53:57.700738 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:57.700725 2583 scope.go:117] "RemoveContainer" containerID="8a84c3869e0f2478030da30c8bdb089f8b616236440b13e014620425fbf2d817" Jul 18 03:53:58.704314 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:58.704265 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" event={"ID":"9c05fae8-ab83-4357-b4eb-446e2dfde6f0","Type":"ContainerStarted","Data":"abe0d3bc2ea123f8e756ad0d8cf4afe07f2854cec928fd32c2d00180218a8af3"} Jul 18 03:53:58.704780 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:58.704587 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:53:58.705128 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:53:58.705110 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-856997c787-h4fz7" Jul 18 03:54:00.823163 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.823122 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b"] Jul 18 03:54:00.826053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.826034 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-656fd4c5b5-wdps8"] Jul 18 03:54:00.826165 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.826145 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:00.828386 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.828360 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 18 03:54:00.828517 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.828461 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cxd8h\"" Jul 18 03:54:00.828517 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.828511 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.828678 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.828582 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 18 03:54:00.828678 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.828603 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.829523 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.829505 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.831589 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.831563 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 18 03:54:00.831932 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.831913 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 18 03:54:00.831998 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.831959 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp4b6\"" Jul 18 03:54:00.832038 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.832016 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 18 03:54:00.841533 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.841511 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b"] Jul 18 03:54:00.844584 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.844567 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 18 03:54:00.855995 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.855969 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656fd4c5b5-wdps8"] Jul 18 03:54:00.913060 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913035 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913175 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913068 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8rwl\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-kube-api-access-w8rwl\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913175 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913114 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fad5863-e66b-4106-bed7-798fb78ff330-config\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:00.913175 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xcks\" (UniqueName: \"kubernetes.io/projected/9fad5863-e66b-4106-bed7-798fb78ff330-kube-api-access-5xcks\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:00.913276 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913192 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-image-registry-private-configuration\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913276 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5d7a63a-5cec-4904-bc13-be87ff032e93-ca-trust-extracted\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913276 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-certificates\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913276 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913268 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-trusted-ca\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913425 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fad5863-e66b-4106-bed7-798fb78ff330-serving-cert\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:00.913425 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-installation-pull-secrets\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.913425 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.913368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-bound-sa-token\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:00.922648 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.922616 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-q8fq6"] Jul 18 03:54:00.925485 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.925468 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84477d5b-9njvc"] Jul 18 03:54:00.925597 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.925580 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:00.927631 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.927610 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 18 03:54:00.927729 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.927640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 18 03:54:00.927729 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.927650 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.927729 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.927667 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tk85c\"" Jul 18 03:54:00.927974 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.927955 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.928111 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.928096 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:00.930407 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.930388 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 18 03:54:00.930533 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.930516 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 18 03:54:00.930667 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.930649 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 18 03:54:00.931056 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.930998 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 03:54:00.931056 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.931019 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n8v8p\"" Jul 18 03:54:00.931283 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.931265 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 18 03:54:00.932716 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.932694 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 03:54:00.934187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.934171 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 18 03:54:00.939748 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.939730 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-q8fq6"] Jul 18 03:54:00.940744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:00.940726 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84477d5b-9njvc"] Jul 18 03:54:01.013940 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.013918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzpsc\" (UniqueName: \"kubernetes.io/projected/2afbc857-ab37-47f3-acea-886d23b871d1-kube-api-access-lzpsc\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.014058 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.013948 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014058 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.013967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a76197cf-e6c9-4336-875a-ff3050804f72-snapshots\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.014058 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.013982 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-installation-pull-secrets\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014058 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8rwl\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-kube-api-access-w8rwl\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014058 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xcks\" (UniqueName: \"kubernetes.io/projected/9fad5863-e66b-4106-bed7-798fb78ff330-kube-api-access-5xcks\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.014062 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.014081 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656fd4c5b5-wdps8: secret "image-registry-tls" not found Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014079 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a76197cf-e6c9-4336-875a-ff3050804f72-tmp\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014113 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7mt6\" (UniqueName: \"kubernetes.io/projected/a76197cf-e6c9-4336-875a-ff3050804f72-kube-api-access-z7mt6\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.014141 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls podName:c5d7a63a-5cec-4904-bc13-be87ff032e93 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:01.514123212 +0000 UTC m=+240.026490733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls") pod "image-registry-656fd4c5b5-wdps8" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93") : secret "image-registry-tls" not found Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014181 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.014240 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fad5863-e66b-4106-bed7-798fb78ff330-serving-cert\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014248 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fad5863-e66b-4106-bed7-798fb78ff330-config\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014316 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-default-certificate\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-image-registry-private-configuration\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-certificates\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5d7a63a-5cec-4904-bc13-be87ff032e93-ca-trust-extracted\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014458 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a76197cf-e6c9-4336-875a-ff3050804f72-serving-cert\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-trusted-ca\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014519 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a76197cf-e6c9-4336-875a-ff3050804f72-service-ca-bundle\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-bound-sa-token\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a76197cf-e6c9-4336-875a-ff3050804f72-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.014661 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-stats-auth\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.015208 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014788 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5d7a63a-5cec-4904-bc13-be87ff032e93-ca-trust-extracted\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.015208 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.014929 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-certificates\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.015208 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.015081 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9fad5863-e66b-4106-bed7-798fb78ff330-config\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.015698 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.015674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-trusted-ca\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.016811 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.016789 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9fad5863-e66b-4106-bed7-798fb78ff330-serving-cert\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.016892 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.016793 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-image-registry-private-configuration\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.016931 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.016907 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-installation-pull-secrets\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.023783 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.023759 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xcks\" (UniqueName: \"kubernetes.io/projected/9fad5863-e66b-4106-bed7-798fb78ff330-kube-api-access-5xcks\") pod \"service-ca-operator-5bcbc94c78-sjz9b\" (UID: \"9fad5863-e66b-4106-bed7-798fb78ff330\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.024185 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.024169 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-bound-sa-token\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.024628 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.024607 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8rwl\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-kube-api-access-w8rwl\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.115251 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115195 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a76197cf-e6c9-4336-875a-ff3050804f72-tmp\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.115251 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7mt6\" (UniqueName: \"kubernetes.io/projected/a76197cf-e6c9-4336-875a-ff3050804f72-kube-api-access-z7mt6\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.115251 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115250 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-default-certificate\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115340 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a76197cf-e6c9-4336-875a-ff3050804f72-serving-cert\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a76197cf-e6c9-4336-875a-ff3050804f72-service-ca-bundle\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115380 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a76197cf-e6c9-4336-875a-ff3050804f72-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.115386 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-stats-auth\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.115421 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:01.615399586 +0000 UTC m=+240.127767119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : configmap references non-existent config key: service-ca.crt Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.115461 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:01.615449265 +0000 UTC m=+240.127816785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : secret "router-metrics-certs-default" not found Jul 18 03:54:01.115484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzpsc\" (UniqueName: \"kubernetes.io/projected/2afbc857-ab37-47f3-acea-886d23b871d1-kube-api-access-lzpsc\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.115993 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a76197cf-e6c9-4336-875a-ff3050804f72-snapshots\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.115993 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.115654 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a76197cf-e6c9-4336-875a-ff3050804f72-tmp\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.116084 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.116033 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a76197cf-e6c9-4336-875a-ff3050804f72-service-ca-bundle\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.116146 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.116129 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a76197cf-e6c9-4336-875a-ff3050804f72-snapshots\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.116564 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.116546 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a76197cf-e6c9-4336-875a-ff3050804f72-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.117644 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.117624 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-default-certificate\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.118075 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.118052 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a76197cf-e6c9-4336-875a-ff3050804f72-serving-cert\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.118150 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.118059 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-stats-auth\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.124576 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.124548 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7mt6\" (UniqueName: \"kubernetes.io/projected/a76197cf-e6c9-4336-875a-ff3050804f72-kube-api-access-z7mt6\") pod \"insights-operator-555d9d7885-q8fq6\" (UID: \"a76197cf-e6c9-4336-875a-ff3050804f72\") " pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.125079 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.125061 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzpsc\" (UniqueName: \"kubernetes.io/projected/2afbc857-ab37-47f3-acea-886d23b871d1-kube-api-access-lzpsc\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.136898 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.136881 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" Jul 18 03:54:01.235888 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.235857 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" Jul 18 03:54:01.260634 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.256756 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b"] Jul 18 03:54:01.261518 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:01.261485 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fad5863_e66b_4106_bed7_798fb78ff330.slice/crio-6dd38f9d716923bcb445355adafb1088c12d1652aaeb0079c37f598aa130c3df WatchSource:0}: Error finding container 6dd38f9d716923bcb445355adafb1088c12d1652aaeb0079c37f598aa130c3df: Status 404 returned error can't find the container with id 6dd38f9d716923bcb445355adafb1088c12d1652aaeb0079c37f598aa130c3df Jul 18 03:54:01.356014 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.355984 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-q8fq6"] Jul 18 03:54:01.359652 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:01.359629 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76197cf_e6c9_4336_875a_ff3050804f72.slice/crio-1fe5f64e16f222d324ec386faa3539584369a3e9ac8587669a259d5b6810c9cf WatchSource:0}: Error finding container 1fe5f64e16f222d324ec386faa3539584369a3e9ac8587669a259d5b6810c9cf: Status 404 returned error can't find the container with id 1fe5f64e16f222d324ec386faa3539584369a3e9ac8587669a259d5b6810c9cf Jul 18 03:54:01.519014 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.518982 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:01.519182 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.519149 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:54:01.519182 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.519164 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656fd4c5b5-wdps8: secret "image-registry-tls" not found Jul 18 03:54:01.519259 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.519220 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls podName:c5d7a63a-5cec-4904-bc13-be87ff032e93 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:02.519201759 +0000 UTC m=+241.031569297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls") pod "image-registry-656fd4c5b5-wdps8" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93") : secret "image-registry-tls" not found Jul 18 03:54:01.619732 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.619690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.619905 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.619742 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:01.619905 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.619858 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:02.619840773 +0000 UTC m=+241.132208292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : configmap references non-existent config key: service-ca.crt Jul 18 03:54:01.619991 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.619913 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 18 03:54:01.619991 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:01.619969 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:02.619954446 +0000 UTC m=+241.132321967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : secret "router-metrics-certs-default" not found Jul 18 03:54:01.712621 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.712576 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" event={"ID":"9fad5863-e66b-4106-bed7-798fb78ff330","Type":"ContainerStarted","Data":"6dd38f9d716923bcb445355adafb1088c12d1652aaeb0079c37f598aa130c3df"} Jul 18 03:54:01.713615 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:01.713578 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" event={"ID":"a76197cf-e6c9-4336-875a-ff3050804f72","Type":"ContainerStarted","Data":"1fe5f64e16f222d324ec386faa3539584369a3e9ac8587669a259d5b6810c9cf"} Jul 18 03:54:02.528055 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:02.527994 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:02.528620 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:02.528135 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:54:02.528620 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:02.528156 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656fd4c5b5-wdps8: secret "image-registry-tls" not found Jul 18 03:54:02.528620 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:02.528219 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls podName:c5d7a63a-5cec-4904-bc13-be87ff032e93 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:04.528200196 +0000 UTC m=+243.040567720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls") pod "image-registry-656fd4c5b5-wdps8" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93") : secret "image-registry-tls" not found Jul 18 03:54:02.629340 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:02.629308 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:02.629520 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:02.629349 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:02.629520 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:02.629447 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 18 03:54:02.629520 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:02.629469 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:04.629449388 +0000 UTC m=+243.141816913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : configmap references non-existent config key: service-ca.crt Jul 18 03:54:02.629520 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:02.629489 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:04.62947925 +0000 UTC m=+243.141846770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : secret "router-metrics-certs-default" not found Jul 18 03:54:04.544579 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.544543 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:04.545031 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:04.544709 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:54:04.545031 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:04.544736 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656fd4c5b5-wdps8: secret "image-registry-tls" not found Jul 18 03:54:04.545031 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:04.544800 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls podName:c5d7a63a-5cec-4904-bc13-be87ff032e93 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.544780807 +0000 UTC m=+247.057148342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls") pod "image-registry-656fd4c5b5-wdps8" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93") : secret "image-registry-tls" not found Jul 18 03:54:04.644935 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.644905 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:04.645111 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.644949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:04.645111 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:04.645071 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 18 03:54:04.645111 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:04.645087 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.645069338 +0000 UTC m=+247.157436862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : configmap references non-existent config key: service-ca.crt Jul 18 03:54:04.645246 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:04.645121 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.645105934 +0000 UTC m=+247.157473470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : secret "router-metrics-certs-default" not found Jul 18 03:54:04.724059 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.724032 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" event={"ID":"a76197cf-e6c9-4336-875a-ff3050804f72","Type":"ContainerStarted","Data":"2af9d1495a3452e9125935d942743e6cbedec0b1bab7702d2d4f7bd9546c1a90"} Jul 18 03:54:04.725522 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.725487 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" event={"ID":"9fad5863-e66b-4106-bed7-798fb78ff330","Type":"ContainerStarted","Data":"3102f9d5f5a89d9c506ee432da3dcee696793c9b8b1777c8fdc1f7bc3d7e6ea6"} Jul 18 03:54:04.740654 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.740607 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" podStartSLOduration=2.422804379 podStartE2EDuration="4.740590534s" totalImagesPullingTime="2.317786155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:04.739196067 +0000 UTC m=+243.251563611" watchObservedRunningTime="2026-07-18 03:54:04.740590534 +0000 UTC m=+243.252958078" Jul 18 03:54:04.759988 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:04.759947 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" podStartSLOduration=2.3449554790000002 podStartE2EDuration="4.759935008s" totalImagesPullingTime="2.414979529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:04.758637767 +0000 UTC m=+243.271005312" watchObservedRunningTime="2026-07-18 03:54:04.759935008 +0000 UTC m=+243.272302548" Jul 18 03:54:05.111854 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.111823 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-phqkq"] Jul 18 03:54:05.115246 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.115222 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.119050 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.119022 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 03:54:05.119050 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.119027 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 03:54:05.119208 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.119191 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wqk9w\"" Jul 18 03:54:05.127241 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.127212 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-phqkq"] Jul 18 03:54:05.249881 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.249850 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zblqw\" (UniqueName: \"kubernetes.io/projected/11917805-3879-4d13-927c-09386d5386da-kube-api-access-zblqw\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.250010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.249890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11917805-3879-4d13-927c-09386d5386da-data-volume\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.250010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.249928 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.250010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.249948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11917805-3879-4d13-927c-09386d5386da-crio-socket\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.250010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.249964 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350465 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.350435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zblqw\" (UniqueName: \"kubernetes.io/projected/11917805-3879-4d13-927c-09386d5386da-kube-api-access-zblqw\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350599 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.350486 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11917805-3879-4d13-927c-09386d5386da-data-volume\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350599 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.350546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350599 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.350578 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11917805-3879-4d13-927c-09386d5386da-crio-socket\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350733 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.350603 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350733 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.350644 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:05.350733 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.350659 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11917805-3879-4d13-927c-09386d5386da-crio-socket\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.350733 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.350723 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:05.850702665 +0000 UTC m=+244.363070189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : configmap "kube-rbac-proxy" not found Jul 18 03:54:05.350931 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.350746 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.350931 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.350803 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:05.850791168 +0000 UTC m=+244.363158692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.351078 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.351060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11917805-3879-4d13-927c-09386d5386da-data-volume\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.362038 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.361985 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zblqw\" (UniqueName: \"kubernetes.io/projected/11917805-3879-4d13-927c-09386d5386da-kube-api-access-zblqw\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.853569 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.853536 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.853979 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:05.853592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:05.853979 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.853634 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:05.853979 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.853713 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:06.85368713 +0000 UTC m=+245.366054660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : configmap "kube-rbac-proxy" not found Jul 18 03:54:05.854102 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.854047 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:05.854172 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:05.854156 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:06.854138644 +0000 UTC m=+245.366506163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:06.860490 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:06.860450 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:06.860490 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:06.860498 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:06.860896 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:06.860571 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:06.860896 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:06.860604 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:06.860896 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:06.860633 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.860617067 +0000 UTC m=+247.372984587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : configmap "kube-rbac-proxy" not found Jul 18 03:54:06.860896 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:06.860651 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:08.860640456 +0000 UTC m=+247.373007975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:06.888455 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:06.888436 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kglbm_1eaa3070-fda9-4718-ba72-caf6ec05585f/dns-node-resolver/0.log" Jul 18 03:54:07.889186 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:07.889157 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jrzq9_c8d80b34-8bef-4571-9ff3-fc5058e52f7d/node-ca/0.log" Jul 18 03:54:08.574390 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:08.574358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:08.574552 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.574496 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 03:54:08.574552 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.574515 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-656fd4c5b5-wdps8: secret "image-registry-tls" not found Jul 18 03:54:08.574624 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.574565 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls podName:c5d7a63a-5cec-4904-bc13-be87ff032e93 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:16.574551808 +0000 UTC m=+255.086919327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls") pod "image-registry-656fd4c5b5-wdps8" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93") : secret "image-registry-tls" not found Jul 18 03:54:08.674881 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:08.674836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:08.675035 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:08.674886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:08.675035 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.674974 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 18 03:54:08.675035 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.675006 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:16.674989967 +0000 UTC m=+255.187357485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : configmap references non-existent config key: service-ca.crt Jul 18 03:54:08.675035 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.675031 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs podName:2afbc857-ab37-47f3-acea-886d23b871d1 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:16.675022841 +0000 UTC m=+255.187390360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs") pod "router-default-84477d5b-9njvc" (UID: "2afbc857-ab37-47f3-acea-886d23b871d1") : secret "router-metrics-certs-default" not found Jul 18 03:54:08.876785 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:08.876714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:08.876785 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:08.876750 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:08.876960 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.876828 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:08.876960 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.876859 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:08.876960 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.876883 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:12.876869368 +0000 UTC m=+251.389236887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : configmap "kube-rbac-proxy" not found Jul 18 03:54:08.876960 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:08.876898 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:12.876892327 +0000 UTC m=+251.389259845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:08.890062 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:08.890039 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gqx9d_b4bc9e1e-384b-4ea9-a4a7-891a4f971b50/serve-healthcheck-canary/0.log" Jul 18 03:54:12.911343 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:12.911283 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:12.911742 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:12.911356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:12.911742 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:12.911402 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 03:54:12.911742 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:12.911464 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:20.911449295 +0000 UTC m=+259.423816815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : configmap "kube-rbac-proxy" not found Jul 18 03:54:12.911742 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:12.911498 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 03:54:12.911742 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:12.911558 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls podName:11917805-3879-4d13-927c-09386d5386da nodeName:}" failed. No retries permitted until 2026-07-18 03:54:20.911542764 +0000 UTC m=+259.423910286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls") pod "insights-runtime-extractor-phqkq" (UID: "11917805-3879-4d13-927c-09386d5386da") : secret "insights-runtime-extractor-tls" not found Jul 18 03:54:13.918514 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:13.918475 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:54:13.918863 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:13.918633 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 03:54:13.918863 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:13.918700 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs podName:41787ee1-0ac0-4a06-a47e-9db479999abd nodeName:}" failed. No retries permitted until 2026-07-18 03:56:15.918683529 +0000 UTC m=+374.431051054 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs") pod "network-metrics-daemon-gdzq9" (UID: "41787ee1-0ac0-4a06-a47e-9db479999abd") : secret "metrics-daemon-secret" not found Jul 18 03:54:16.641504 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.641464 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:16.643830 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.643806 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"image-registry-656fd4c5b5-wdps8\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:16.742010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.741982 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:16.742130 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.742017 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:16.742631 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.742610 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2afbc857-ab37-47f3-acea-886d23b871d1-service-ca-bundle\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:16.742934 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.742917 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kp4b6\"" Jul 18 03:54:16.744274 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.744257 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2afbc857-ab37-47f3-acea-886d23b871d1-metrics-certs\") pod \"router-default-84477d5b-9njvc\" (UID: \"2afbc857-ab37-47f3-acea-886d23b871d1\") " pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:16.751100 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.751081 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:16.843820 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.843794 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n8v8p\"" Jul 18 03:54:16.852530 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.852509 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:16.874140 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.874114 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-656fd4c5b5-wdps8"] Jul 18 03:54:16.876064 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:16.876043 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d7a63a_5cec_4904_bc13_be87ff032e93.slice/crio-c694cd3ff36f4192b934e4e7ba90ed3f59d7816459caa38744b491aff332d96c WatchSource:0}: Error finding container c694cd3ff36f4192b934e4e7ba90ed3f59d7816459caa38744b491aff332d96c: Status 404 returned error can't find the container with id c694cd3ff36f4192b934e4e7ba90ed3f59d7816459caa38744b491aff332d96c Jul 18 03:54:16.981360 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:16.981334 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84477d5b-9njvc"] Jul 18 03:54:16.983527 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:16.983503 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afbc857_ab37_47f3_acea_886d23b871d1.slice/crio-56efeb38b0b70ac508afaad6ae9346da627fb353b3d1772d707a2275ce5de0bf WatchSource:0}: Error finding container 56efeb38b0b70ac508afaad6ae9346da627fb353b3d1772d707a2275ce5de0bf: Status 404 returned error can't find the container with id 56efeb38b0b70ac508afaad6ae9346da627fb353b3d1772d707a2275ce5de0bf Jul 18 03:54:17.763066 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.763026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84477d5b-9njvc" event={"ID":"2afbc857-ab37-47f3-acea-886d23b871d1","Type":"ContainerStarted","Data":"120866567fd402accc41fbee502e1e8211fae97e11c58f53dee66eeec088b2d6"} Jul 18 03:54:17.763531 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.763088 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84477d5b-9njvc" event={"ID":"2afbc857-ab37-47f3-acea-886d23b871d1","Type":"ContainerStarted","Data":"56efeb38b0b70ac508afaad6ae9346da627fb353b3d1772d707a2275ce5de0bf"} Jul 18 03:54:17.764446 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.764418 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" event={"ID":"c5d7a63a-5cec-4904-bc13-be87ff032e93","Type":"ContainerStarted","Data":"e65b3f5daccfac6f5331595496aef3e36534acb017b16df9ba53d903ce86804e"} Jul 18 03:54:17.764545 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.764462 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" event={"ID":"c5d7a63a-5cec-4904-bc13-be87ff032e93","Type":"ContainerStarted","Data":"c694cd3ff36f4192b934e4e7ba90ed3f59d7816459caa38744b491aff332d96c"} Jul 18 03:54:17.764545 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.764484 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:17.779137 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.779097 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84477d5b-9njvc" podStartSLOduration=17.779084397 podStartE2EDuration="17.779084397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:17.77876143 +0000 UTC m=+256.291129004" watchObservedRunningTime="2026-07-18 03:54:17.779084397 +0000 UTC m=+256.291451955" Jul 18 03:54:17.795453 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.795413 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" podStartSLOduration=17.795400483999998 podStartE2EDuration="17.795400484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:17.793960419 +0000 UTC m=+256.306327982" watchObservedRunningTime="2026-07-18 03:54:17.795400484 +0000 UTC m=+256.307768026" Jul 18 03:54:17.852877 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.852856 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:17.855280 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:17.855262 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:18.767216 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:18.767186 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:18.768379 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:18.768357 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84477d5b-9njvc" Jul 18 03:54:20.974401 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:20.974367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:20.974808 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:20.974443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:20.975410 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:20.975368 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11917805-3879-4d13-927c-09386d5386da-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:20.978875 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:20.978851 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11917805-3879-4d13-927c-09386d5386da-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-phqkq\" (UID: \"11917805-3879-4d13-927c-09386d5386da\") " pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:21.024588 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:21.024563 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-phqkq" Jul 18 03:54:21.145116 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:21.145087 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-phqkq"] Jul 18 03:54:21.148449 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:21.148422 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11917805_3879_4d13_927c_09386d5386da.slice/crio-81121c15c40c40a3e988c9c25a87b2cd91a8e038eb6b34c745bcbf8060965222 WatchSource:0}: Error finding container 81121c15c40c40a3e988c9c25a87b2cd91a8e038eb6b34c745bcbf8060965222: Status 404 returned error can't find the container with id 81121c15c40c40a3e988c9c25a87b2cd91a8e038eb6b34c745bcbf8060965222 Jul 18 03:54:21.778832 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:21.778790 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-phqkq" event={"ID":"11917805-3879-4d13-927c-09386d5386da","Type":"ContainerStarted","Data":"81121c15c40c40a3e988c9c25a87b2cd91a8e038eb6b34c745bcbf8060965222"} Jul 18 03:54:26.797151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:26.797113 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-phqkq" event={"ID":"11917805-3879-4d13-927c-09386d5386da","Type":"ContainerStarted","Data":"3106cb27ef95ab2664ed1f6d9554127d57f0bacd363e6c33cc26975ef920e250"} Jul 18 03:54:28.782684 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:28.782641 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656fd4c5b5-wdps8"] Jul 18 03:54:29.811417 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:29.811378 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-phqkq" event={"ID":"11917805-3879-4d13-927c-09386d5386da","Type":"ContainerStarted","Data":"f2a400df31a270934bd3d9ab85abe5366527ba75d08f4abf430b75115e04e393"} Jul 18 03:54:33.827294 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:33.827255 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-phqkq" event={"ID":"11917805-3879-4d13-927c-09386d5386da","Type":"ContainerStarted","Data":"09ba758f5d7efd375925231a4ca5420f9c3c16e491104a101f26df5f83e3497f"} Jul 18 03:54:33.843805 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:33.843757 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-phqkq" podStartSLOduration=17.339166632 podStartE2EDuration="28.843743166s" totalImagesPullingTime="11.504576534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 03:54:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:33.842082665 +0000 UTC m=+272.354450205" watchObservedRunningTime="2026-07-18 03:54:33.843743166 +0000 UTC m=+272.356110742" Jul 18 03:54:35.352846 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.352807 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr"] Jul 18 03:54:35.355944 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.355927 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:35.357990 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.357965 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 18 03:54:35.358105 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.357986 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5nzz9\"" Jul 18 03:54:35.364579 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.364561 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr"] Jul 18 03:54:35.487719 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.487696 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6d76ba69-b489-44c9-aaed-2a81a21c018e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fhnmr\" (UID: \"6d76ba69-b489-44c9-aaed-2a81a21c018e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:35.588049 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.588013 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6d76ba69-b489-44c9-aaed-2a81a21c018e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fhnmr\" (UID: \"6d76ba69-b489-44c9-aaed-2a81a21c018e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:35.590472 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.590452 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/6d76ba69-b489-44c9-aaed-2a81a21c018e-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-fhnmr\" (UID: \"6d76ba69-b489-44c9-aaed-2a81a21c018e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:35.664276 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.664248 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:35.780418 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.780388 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr"] Jul 18 03:54:35.783352 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:35.783326 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d76ba69_b489_44c9_aaed_2a81a21c018e.slice/crio-3d2c6a45f7703c0ceec27dcceb0733d72a268d8a55562b5df15bd54e866afad7 WatchSource:0}: Error finding container 3d2c6a45f7703c0ceec27dcceb0733d72a268d8a55562b5df15bd54e866afad7: Status 404 returned error can't find the container with id 3d2c6a45f7703c0ceec27dcceb0733d72a268d8a55562b5df15bd54e866afad7 Jul 18 03:54:35.834999 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:35.834967 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" event={"ID":"6d76ba69-b489-44c9-aaed-2a81a21c018e","Type":"ContainerStarted","Data":"3d2c6a45f7703c0ceec27dcceb0733d72a268d8a55562b5df15bd54e866afad7"} Jul 18 03:54:37.842632 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:37.842599 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" event={"ID":"6d76ba69-b489-44c9-aaed-2a81a21c018e","Type":"ContainerStarted","Data":"f7391450ec475bda1b8c9a6bfaeed45997052cd83b9c8beea0a3bfc0889476af"} Jul 18 03:54:37.843010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:37.842828 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:37.847045 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:37.847023 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" Jul 18 03:54:37.856343 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:37.856292 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-fhnmr" podStartSLOduration=1.7293852379999999 podStartE2EDuration="2.856280259s" totalImagesPullingTime="1.126895021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:37.855247097 +0000 UTC m=+276.367614638" watchObservedRunningTime="2026-07-18 03:54:37.856280259 +0000 UTC m=+276.368647800" Jul 18 03:54:38.405368 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.405336 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t"] Jul 18 03:54:38.409147 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.409130 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.411262 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.411239 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tbk7b\"" Jul 18 03:54:38.411416 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.411288 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 03:54:38.411416 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.411368 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 03:54:38.411416 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.411369 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 18 03:54:38.411416 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.411239 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 18 03:54:38.411587 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.411504 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 03:54:38.416737 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.416717 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t"] Jul 18 03:54:38.508628 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.508599 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68592025-9afb-4084-b7a8-a1748b7d9359-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.508749 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.508629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjt8\" (UniqueName: \"kubernetes.io/projected/68592025-9afb-4084-b7a8-a1748b7d9359-kube-api-access-8vjt8\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.508749 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.508670 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68592025-9afb-4084-b7a8-a1748b7d9359-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.508749 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.508709 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68592025-9afb-4084-b7a8-a1748b7d9359-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.609524 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.609497 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjt8\" (UniqueName: \"kubernetes.io/projected/68592025-9afb-4084-b7a8-a1748b7d9359-kube-api-access-8vjt8\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.609644 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.609539 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68592025-9afb-4084-b7a8-a1748b7d9359-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.609644 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.609567 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68592025-9afb-4084-b7a8-a1748b7d9359-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.609644 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.609627 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68592025-9afb-4084-b7a8-a1748b7d9359-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.610268 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.610248 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68592025-9afb-4084-b7a8-a1748b7d9359-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.612047 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.612026 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/68592025-9afb-4084-b7a8-a1748b7d9359-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.612140 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.612031 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/68592025-9afb-4084-b7a8-a1748b7d9359-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.619092 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.619068 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjt8\" (UniqueName: \"kubernetes.io/projected/68592025-9afb-4084-b7a8-a1748b7d9359-kube-api-access-8vjt8\") pod \"prometheus-operator-5945b5cfd-4bb5t\" (UID: \"68592025-9afb-4084-b7a8-a1748b7d9359\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.718744 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.718688 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" Jul 18 03:54:38.788720 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.788689 2583 patch_prober.go:28] interesting pod/image-registry-656fd4c5b5-wdps8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 18 03:54:38.788881 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.788761 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 03:54:38.840150 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:38.840120 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t"] Jul 18 03:54:38.843167 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:38.843133 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68592025_9afb_4084_b7a8_a1748b7d9359.slice/crio-052a64065c289e96e46faa999c6204765e088b834d3c6551ca4022e406406b8a WatchSource:0}: Error finding container 052a64065c289e96e46faa999c6204765e088b834d3c6551ca4022e406406b8a: Status 404 returned error can't find the container with id 052a64065c289e96e46faa999c6204765e088b834d3c6551ca4022e406406b8a Jul 18 03:54:39.850859 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:39.850827 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" event={"ID":"68592025-9afb-4084-b7a8-a1748b7d9359","Type":"ContainerStarted","Data":"052a64065c289e96e46faa999c6204765e088b834d3c6551ca4022e406406b8a"} Jul 18 03:54:40.855126 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:40.855086 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" event={"ID":"68592025-9afb-4084-b7a8-a1748b7d9359","Type":"ContainerStarted","Data":"f378fc43608d38510bc0c990cfd775be538a8b48e3068b3c1277a70a44caabf5"} Jul 18 03:54:40.855560 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:40.855137 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" event={"ID":"68592025-9afb-4084-b7a8-a1748b7d9359","Type":"ContainerStarted","Data":"75d98f753e40a0d92babdf678989df97c662291c62a233649cfcec4a5d692d69"} Jul 18 03:54:40.871003 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:40.870955 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4bb5t" podStartSLOduration=1.557459339 podStartE2EDuration="2.870942436s" totalImagesPullingTime="1.313483097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:40.869210652 +0000 UTC m=+279.381578215" watchObservedRunningTime="2026-07-18 03:54:40.870942436 +0000 UTC m=+279.383309976" Jul 18 03:54:42.731386 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.731347 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482"] Jul 18 03:54:42.734763 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.734741 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.736877 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.736845 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 18 03:54:42.736977 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.736881 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 18 03:54:42.736977 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.736879 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wnhm2\"" Jul 18 03:54:42.745148 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.745129 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482"] Jul 18 03:54:42.762283 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.762258 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2xgb2"] Jul 18 03:54:42.765266 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.765249 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.767242 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.767225 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 18 03:54:42.767381 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.767362 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5tgvd\"" Jul 18 03:54:42.767627 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.767612 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 18 03:54:42.767668 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.767645 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 18 03:54:42.774161 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.774139 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2xgb2"] Jul 18 03:54:42.777368 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.777347 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lmsvh"] Jul 18 03:54:42.780666 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.780647 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.782943 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.782920 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 03:54:42.783808 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.783261 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 03:54:42.783808 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.783496 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-np8nl\"" Jul 18 03:54:42.783808 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.783670 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 03:54:42.841029 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.840991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841029 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841031 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.841226 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841049 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4wbh\" (UniqueName: \"kubernetes.io/projected/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-kube-api-access-k4wbh\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.841226 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841128 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms8t5\" (UniqueName: \"kubernetes.io/projected/141e6639-8b03-4482-b178-268acd0ebe08-kube-api-access-ms8t5\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.841226 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841199 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.841348 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841228 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-root\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841348 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841244 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-textfile\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841348 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.841348 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-wtmp\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841467 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841380 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/141e6639-8b03-4482-b178-268acd0ebe08-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.841467 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841407 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841467 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841435 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.841467 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841460 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.841730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841486 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4ct2\" (UniqueName: \"kubernetes.io/projected/b3f33ed1-cef9-4a25-8408-812804478b5d-kube-api-access-p4ct2\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841517 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-sys\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841538 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-tls\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.841730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841579 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/141e6639-8b03-4482-b178-268acd0ebe08-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.841730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841599 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.841730 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.841617 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3f33ed1-cef9-4a25-8408-812804478b5d-metrics-client-ca\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.942611 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.942611 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.942871 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4wbh\" (UniqueName: \"kubernetes.io/projected/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-kube-api-access-k4wbh\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.942871 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms8t5\" (UniqueName: \"kubernetes.io/projected/141e6639-8b03-4482-b178-268acd0ebe08-kube-api-access-ms8t5\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.942871 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.942871 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-root\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.942871 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942759 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-textfile\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.942871 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942836 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-root\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943138 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.942958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.943138 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943010 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-wtmp\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943138 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-textfile\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943138 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:42.943088 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 18 03:54:42.943138 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943129 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/141e6639-8b03-4482-b178-268acd0ebe08-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:42.943145 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-tls podName:141e6639-8b03-4482-b178-268acd0ebe08 nodeName:}" failed. No retries permitted until 2026-07-18 03:54:43.443125586 +0000 UTC m=+281.955493124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-2xgb2" (UID: "141e6639-8b03-4482-b178-268acd0ebe08") : secret "kube-state-metrics-tls" not found Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-wtmp\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943183 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943229 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.943426 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943402 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4ct2\" (UniqueName: \"kubernetes.io/projected/b3f33ed1-cef9-4a25-8408-812804478b5d-kube-api-access-p4ct2\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-sys\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-tls\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943484 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/141e6639-8b03-4482-b178-268acd0ebe08-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943494 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/141e6639-8b03-4482-b178-268acd0ebe08-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943627 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3f33ed1-cef9-4a25-8408-812804478b5d-sys\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.943786 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943753 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3f33ed1-cef9-4a25-8408-812804478b5d-metrics-client-ca\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.944086 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.943959 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.944285 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.944261 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3f33ed1-cef9-4a25-8408-812804478b5d-metrics-client-ca\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.944383 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.944368 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.944441 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.944399 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/141e6639-8b03-4482-b178-268acd0ebe08-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.945718 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.945682 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.945843 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.945823 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-tls\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.946150 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.946128 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.946309 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.946277 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.946375 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.946343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3f33ed1-cef9-4a25-8408-812804478b5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:42.948950 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.948928 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms8t5\" (UniqueName: \"kubernetes.io/projected/141e6639-8b03-4482-b178-268acd0ebe08-kube-api-access-ms8t5\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:42.953938 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.951859 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4wbh\" (UniqueName: \"kubernetes.io/projected/c406bb95-caa7-4d7f-85da-9400d7a2c0a6-kube-api-access-k4wbh\") pod \"openshift-state-metrics-79f6958cdf-xx482\" (UID: \"c406bb95-caa7-4d7f-85da-9400d7a2c0a6\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:42.956806 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:42.956781 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4ct2\" (UniqueName: \"kubernetes.io/projected/b3f33ed1-cef9-4a25-8408-812804478b5d-kube-api-access-p4ct2\") pod \"node-exporter-lmsvh\" (UID: \"b3f33ed1-cef9-4a25-8408-812804478b5d\") " pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:43.043113 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.043044 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" Jul 18 03:54:43.097386 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.097355 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmsvh" Jul 18 03:54:43.110369 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:43.110341 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f33ed1_cef9_4a25_8408_812804478b5d.slice/crio-cfc656fb66a465ef19f7447932a4095d0a4cb8b855c16b2c6626514149d2dd0a WatchSource:0}: Error finding container cfc656fb66a465ef19f7447932a4095d0a4cb8b855c16b2c6626514149d2dd0a: Status 404 returned error can't find the container with id cfc656fb66a465ef19f7447932a4095d0a4cb8b855c16b2c6626514149d2dd0a Jul 18 03:54:43.163420 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.163336 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482"] Jul 18 03:54:43.165337 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:43.165281 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc406bb95_caa7_4d7f_85da_9400d7a2c0a6.slice/crio-826441f45b4298e82fbf902468b7ef0a3fa2c4e780f3b3270f241a59e531de0b WatchSource:0}: Error finding container 826441f45b4298e82fbf902468b7ef0a3fa2c4e780f3b3270f241a59e531de0b: Status 404 returned error can't find the container with id 826441f45b4298e82fbf902468b7ef0a3fa2c4e780f3b3270f241a59e531de0b Jul 18 03:54:43.447001 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.446971 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:43.449341 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.449317 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/141e6639-8b03-4482-b178-268acd0ebe08-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2xgb2\" (UID: \"141e6639-8b03-4482-b178-268acd0ebe08\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:43.518355 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:43.518323 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7887m" podUID="49275967-d1a5-417e-a356-b4a6d853337b" Jul 18 03:54:43.673257 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.673219 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" Jul 18 03:54:43.826078 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.824540 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2xgb2"] Jul 18 03:54:43.830268 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:43.830235 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141e6639_8b03_4482_b178_268acd0ebe08.slice/crio-d025d6d052a7cc742ff4ab4152fd8d81dcf2bce2d6789009de6c6aca4c3e04c4 WatchSource:0}: Error finding container d025d6d052a7cc742ff4ab4152fd8d81dcf2bce2d6789009de6c6aca4c3e04c4: Status 404 returned error can't find the container with id d025d6d052a7cc742ff4ab4152fd8d81dcf2bce2d6789009de6c6aca4c3e04c4 Jul 18 03:54:43.869814 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.869779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" event={"ID":"c406bb95-caa7-4d7f-85da-9400d7a2c0a6","Type":"ContainerStarted","Data":"9d5fb2060826466be426e57b21701aa024cab44454ac04139db69d4614fb2366"} Jul 18 03:54:43.869942 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.869846 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" event={"ID":"c406bb95-caa7-4d7f-85da-9400d7a2c0a6","Type":"ContainerStarted","Data":"d57b450f65522a5997204f8d7b80234f3b0ad1a5976e99fadfd4bf3f69f7c0fc"} Jul 18 03:54:43.869942 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.869905 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" event={"ID":"c406bb95-caa7-4d7f-85da-9400d7a2c0a6","Type":"ContainerStarted","Data":"826441f45b4298e82fbf902468b7ef0a3fa2c4e780f3b3270f241a59e531de0b"} Jul 18 03:54:43.871264 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.871234 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" event={"ID":"141e6639-8b03-4482-b178-268acd0ebe08","Type":"ContainerStarted","Data":"d025d6d052a7cc742ff4ab4152fd8d81dcf2bce2d6789009de6c6aca4c3e04c4"} Jul 18 03:54:43.872683 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.872658 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmsvh" event={"ID":"b3f33ed1-cef9-4a25-8408-812804478b5d","Type":"ContainerStarted","Data":"cfc656fb66a465ef19f7447932a4095d0a4cb8b855c16b2c6626514149d2dd0a"} Jul 18 03:54:43.872785 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:43.872694 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7887m" Jul 18 03:54:44.878911 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:44.878862 2583 generic.go:356] "Generic (PLEG): container finished" podID="b3f33ed1-cef9-4a25-8408-812804478b5d" containerID="66f53ddada61fc699507b78d7853d644df6db27f0938748e1ca1cfaa4b12acad" exitCode=0 Jul 18 03:54:44.879417 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:44.878961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmsvh" event={"ID":"b3f33ed1-cef9-4a25-8408-812804478b5d","Type":"ContainerDied","Data":"66f53ddada61fc699507b78d7853d644df6db27f0938748e1ca1cfaa4b12acad"} Jul 18 03:54:44.881442 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:44.881412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" event={"ID":"c406bb95-caa7-4d7f-85da-9400d7a2c0a6","Type":"ContainerStarted","Data":"110d4011c4898859cac05edba1e6e4e0646cd3aca36d561f03155662e911f1f2"} Jul 18 03:54:44.909438 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:44.909395 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-xx482" podStartSLOduration=1.810084915 podStartE2EDuration="2.909381673s" totalImagesPullingTime="1.099296758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:44.908097574 +0000 UTC m=+283.420465137" watchObservedRunningTime="2026-07-18 03:54:44.909381673 +0000 UTC m=+283.421749213" Jul 18 03:54:45.887119 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.887084 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" event={"ID":"141e6639-8b03-4482-b178-268acd0ebe08","Type":"ContainerStarted","Data":"c15860438f6b844d073a7617ee715205e2cccc1ccfce557dfa435e65a8074d04"} Jul 18 03:54:45.887592 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.887149 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" event={"ID":"141e6639-8b03-4482-b178-268acd0ebe08","Type":"ContainerStarted","Data":"22bde0252d57dffb41ea0e06cd6b805a8ef9d8cf862afd71d654825f00dc9d26"} Jul 18 03:54:45.887592 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.887171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" event={"ID":"141e6639-8b03-4482-b178-268acd0ebe08","Type":"ContainerStarted","Data":"56fcef3a30e52e9a940475f4bbba9d4d3f8fe5e230450438e391d811ea282f1a"} Jul 18 03:54:45.889341 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.889309 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmsvh" event={"ID":"b3f33ed1-cef9-4a25-8408-812804478b5d","Type":"ContainerStarted","Data":"ed8840108321e09e6ec6887f64caa9651aaead315ff5d0ee417614b9ed937772"} Jul 18 03:54:45.889465 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.889373 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmsvh" event={"ID":"b3f33ed1-cef9-4a25-8408-812804478b5d","Type":"ContainerStarted","Data":"bb54921cd020ea60566af64cd9485eb9263a859093ac8dcc1f1d6ca582f93eb9"} Jul 18 03:54:45.903636 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.903589 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2xgb2" podStartSLOduration=2.568739557 podStartE2EDuration="3.903575224s" totalImagesPullingTime="1.334835667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:45.903165155 +0000 UTC m=+284.415532710" watchObservedRunningTime="2026-07-18 03:54:45.903575224 +0000 UTC m=+284.415942795" Jul 18 03:54:45.919595 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:45.919547 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lmsvh" podStartSLOduration=2.6042704199999998 podStartE2EDuration="3.919533514s" totalImagesPullingTime="1.24968664s" totalInitContainerRuntime="65.576454ms" isStatefulPod=true podCreationTimestamp="2026-07-18 03:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:45.918869865 +0000 UTC m=+284.431237406" watchObservedRunningTime="2026-07-18 03:54:45.919533514 +0000 UTC m=+284.431901056" Jul 18 03:54:47.054428 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.054398 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6ffb887499-4jxvc"] Jul 18 03:54:47.057404 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.057388 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.059775 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.059746 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 18 03:54:47.060729 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.060701 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cfgoril6e43td\"" Jul 18 03:54:47.060729 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.060726 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 18 03:54:47.060879 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.060726 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 18 03:54:47.060879 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.060812 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mrqhl\"" Jul 18 03:54:47.060988 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.060974 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 18 03:54:47.067484 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.067466 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ffb887499-4jxvc"] Jul 18 03:54:47.079485 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a7a74570-50a9-4ab3-a108-f3a61c973747-audit-log\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.079571 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079503 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-secret-metrics-server-tls\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.079571 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079530 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a7a74570-50a9-4ab3-a108-f3a61c973747-metrics-server-audit-profiles\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.079650 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:54:47.079650 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-client-ca-bundle\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.079761 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079738 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-secret-metrics-server-client-certs\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.079815 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/a7a74570-50a9-4ab3-a108-f3a61c973747-kube-api-access-gtnt8\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.079855 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.079843 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a74570-50a9-4ab3-a108-f3a61c973747-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.081909 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.081892 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49275967-d1a5-417e-a356-b4a6d853337b-metrics-tls\") pod \"dns-default-7887m\" (UID: \"49275967-d1a5-417e-a356-b4a6d853337b\") " pod="openshift-dns/dns-default-7887m" Jul 18 03:54:47.175955 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.175933 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rnqn\"" Jul 18 03:54:47.180837 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.180817 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a7a74570-50a9-4ab3-a108-f3a61c973747-metrics-server-audit-profiles\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.180894 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.180854 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-client-ca-bundle\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.180894 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.180876 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-secret-metrics-server-client-certs\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181033 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/a7a74570-50a9-4ab3-a108-f3a61c973747-kube-api-access-gtnt8\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181072 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181059 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a74570-50a9-4ab3-a108-f3a61c973747-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181110 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a7a74570-50a9-4ab3-a108-f3a61c973747-audit-log\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181154 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-secret-metrics-server-tls\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181520 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181502 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a7a74570-50a9-4ab3-a108-f3a61c973747-audit-log\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181814 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181792 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7a74570-50a9-4ab3-a108-f3a61c973747-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.181982 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.181960 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a7a74570-50a9-4ab3-a108-f3a61c973747-metrics-server-audit-profiles\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.183391 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.183361 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-secret-metrics-server-tls\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.183492 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.183440 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-secret-metrics-server-client-certs\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.183556 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.183497 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a7a74570-50a9-4ab3-a108-f3a61c973747-client-ca-bundle\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.184164 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.184149 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7887m" Jul 18 03:54:47.189026 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.188997 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnt8\" (UniqueName: \"kubernetes.io/projected/a7a74570-50a9-4ab3-a108-f3a61c973747-kube-api-access-gtnt8\") pod \"metrics-server-6ffb887499-4jxvc\" (UID: \"a7a74570-50a9-4ab3-a108-f3a61c973747\") " pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.306560 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.306495 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7887m"] Jul 18 03:54:47.309448 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:47.309423 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49275967_d1a5_417e_a356_b4a6d853337b.slice/crio-80aae5a92a0d52e90756bad0ecc1745f24f2a371d548763042818bf69c04a5f1 WatchSource:0}: Error finding container 80aae5a92a0d52e90756bad0ecc1745f24f2a371d548763042818bf69c04a5f1: Status 404 returned error can't find the container with id 80aae5a92a0d52e90756bad0ecc1745f24f2a371d548763042818bf69c04a5f1 Jul 18 03:54:47.366589 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.366560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:54:47.492199 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.492167 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6ffb887499-4jxvc"] Jul 18 03:54:47.495362 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:47.495336 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a74570_50a9_4ab3_a108_f3a61c973747.slice/crio-82340b40fb318f9db2b51c6867eefe7268464a58ccc7ce928dd80a3d7e3f5720 WatchSource:0}: Error finding container 82340b40fb318f9db2b51c6867eefe7268464a58ccc7ce928dd80a3d7e3f5720: Status 404 returned error can't find the container with id 82340b40fb318f9db2b51c6867eefe7268464a58ccc7ce928dd80a3d7e3f5720 Jul 18 03:54:47.899372 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.899293 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7887m" event={"ID":"49275967-d1a5-417e-a356-b4a6d853337b","Type":"ContainerStarted","Data":"80aae5a92a0d52e90756bad0ecc1745f24f2a371d548763042818bf69c04a5f1"} Jul 18 03:54:47.900634 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:47.900602 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" event={"ID":"a7a74570-50a9-4ab3-a108-f3a61c973747","Type":"ContainerStarted","Data":"82340b40fb318f9db2b51c6867eefe7268464a58ccc7ce928dd80a3d7e3f5720"} Jul 18 03:54:48.788865 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:48.788821 2583 patch_prober.go:28] interesting pod/image-registry-656fd4c5b5-wdps8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 18 03:54:48.789349 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:48.788880 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 03:54:49.263435 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.263395 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-766497bcc7-4ktkk"] Jul 18 03:54:49.267187 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.267160 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.270937 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.270911 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 03:54:49.271087 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.270949 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 03:54:49.272015 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.271815 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 03:54:49.272015 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.271869 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 03:54:49.272015 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.271890 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 03:54:49.272231 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.272180 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 03:54:49.272558 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.272412 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 03:54:49.272558 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.272544 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-94tc7\"" Jul 18 03:54:49.277143 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.276969 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 03:54:49.279511 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.279454 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766497bcc7-4ktkk"] Jul 18 03:54:49.306043 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.305995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-service-ca\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.306223 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.306056 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-oauth-config\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.306223 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.306117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-oauth-serving-cert\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.306223 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.306154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-trusted-ca-bundle\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.306223 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.306190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-serving-cert\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.306457 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.306221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-config\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.306457 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.306247 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cv5l\" (UniqueName: \"kubernetes.io/projected/98781c8d-3cf5-4d1c-b79c-e54ca905de50-kube-api-access-7cv5l\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407078 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-config\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407171 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407085 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cv5l\" (UniqueName: \"kubernetes.io/projected/98781c8d-3cf5-4d1c-b79c-e54ca905de50-kube-api-access-7cv5l\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407171 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-service-ca\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407171 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-oauth-config\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407327 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-oauth-serving-cert\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407327 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407207 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-trusted-ca-bundle\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.407327 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407237 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-serving-cert\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.408081 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407888 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-config\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.408081 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.407941 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-oauth-serving-cert\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.408081 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.408026 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-service-ca\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.408291 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.408272 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-trusted-ca-bundle\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.409910 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.409886 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-oauth-config\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.409998 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.409936 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-serving-cert\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.414452 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.414428 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cv5l\" (UniqueName: \"kubernetes.io/projected/98781c8d-3cf5-4d1c-b79c-e54ca905de50-kube-api-access-7cv5l\") pod \"console-766497bcc7-4ktkk\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.581019 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.580993 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:49.706337 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.706290 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-766497bcc7-4ktkk"] Jul 18 03:54:49.709768 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:54:49.709740 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98781c8d_3cf5_4d1c_b79c_e54ca905de50.slice/crio-aaae1e6a4c894d03fe1e63998ca4acda634d02b27ed4a6f238a4a7a6a3a4c42e WatchSource:0}: Error finding container aaae1e6a4c894d03fe1e63998ca4acda634d02b27ed4a6f238a4a7a6a3a4c42e: Status 404 returned error can't find the container with id aaae1e6a4c894d03fe1e63998ca4acda634d02b27ed4a6f238a4a7a6a3a4c42e Jul 18 03:54:49.910694 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.910649 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" event={"ID":"a7a74570-50a9-4ab3-a108-f3a61c973747","Type":"ContainerStarted","Data":"096790d8bade29bc34f8ebde3823781aeab08e4be65c86b6a32af09548d6c905"} Jul 18 03:54:49.912482 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.912451 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7887m" event={"ID":"49275967-d1a5-417e-a356-b4a6d853337b","Type":"ContainerStarted","Data":"5eee505b5e1544cd3b10c587c40f80792fc8f894916ce7127ab854ae65b48a3c"} Jul 18 03:54:49.912602 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.912504 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7887m" event={"ID":"49275967-d1a5-417e-a356-b4a6d853337b","Type":"ContainerStarted","Data":"31bb6cc54dcc649869fc4fef3a95ec69ae926d93a0500b97c3999d678fbdce2e"} Jul 18 03:54:49.912602 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.912535 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7887m" Jul 18 03:54:49.913597 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.913561 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766497bcc7-4ktkk" event={"ID":"98781c8d-3cf5-4d1c-b79c-e54ca905de50","Type":"ContainerStarted","Data":"aaae1e6a4c894d03fe1e63998ca4acda634d02b27ed4a6f238a4a7a6a3a4c42e"} Jul 18 03:54:49.925810 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.925770 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" podStartSLOduration=1.026073512 podStartE2EDuration="2.925757293s" totalImagesPullingTime="1.899683781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:49.924839087 +0000 UTC m=+288.437206629" watchObservedRunningTime="2026-07-18 03:54:49.925757293 +0000 UTC m=+288.438124834" Jul 18 03:54:49.938607 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:49.938567 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7887m" podStartSLOduration=250.853042964 podStartE2EDuration="4m12.938559634s" totalImagesPullingTime="2.08551667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:49.938205006 +0000 UTC m=+288.450572548" watchObservedRunningTime="2026-07-18 03:54:49.938559634 +0000 UTC m=+288.450927175" Jul 18 03:54:52.928499 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:52.928460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766497bcc7-4ktkk" event={"ID":"98781c8d-3cf5-4d1c-b79c-e54ca905de50","Type":"ContainerStarted","Data":"517a1e4c7c687434d186b42e08208827cc34d972a78d863ebff8ec8a3a12d8df"} Jul 18 03:54:52.945011 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:52.944964 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-766497bcc7-4ktkk" podStartSLOduration=1.171843056 podStartE2EDuration="3.944951995s" totalImagesPullingTime="2.773108939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:54:52.94345184 +0000 UTC m=+291.455819376" watchObservedRunningTime="2026-07-18 03:54:52.944951995 +0000 UTC m=+291.457319535" Jul 18 03:54:53.810360 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:53.810321 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerName="registry" containerID="cri-o://e65b3f5daccfac6f5331595496aef3e36534acb017b16df9ba53d903ce86804e" gracePeriod=30 Jul 18 03:54:53.935668 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:53.935631 2583 generic.go:356] "Generic (PLEG): container finished" podID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerID="e65b3f5daccfac6f5331595496aef3e36534acb017b16df9ba53d903ce86804e" exitCode=0 Jul 18 03:54:53.935970 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:53.935696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" event={"ID":"c5d7a63a-5cec-4904-bc13-be87ff032e93","Type":"ContainerDied","Data":"e65b3f5daccfac6f5331595496aef3e36534acb017b16df9ba53d903ce86804e"} Jul 18 03:54:54.071215 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.071191 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:54.155381 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155333 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5d7a63a-5cec-4904-bc13-be87ff032e93-ca-trust-extracted\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155565 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155414 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-bound-sa-token\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155565 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155450 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155565 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155471 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-certificates\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155565 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155501 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8rwl\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-kube-api-access-w8rwl\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155565 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155545 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-image-registry-private-configuration\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155797 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155580 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-trusted-ca\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155797 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155624 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-installation-pull-secrets\") pod \"c5d7a63a-5cec-4904-bc13-be87ff032e93\" (UID: \"c5d7a63a-5cec-4904-bc13-be87ff032e93\") " Jul 18 03:54:54.155931 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.155900 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:54:54.156139 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.156021 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:54:54.158125 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.158094 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:54:54.158238 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.158132 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:54:54.158364 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.158342 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:54:54.161259 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.161232 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:54:54.161259 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.161243 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-kube-api-access-w8rwl" (OuterVolumeSpecName: "kube-api-access-w8rwl") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "kube-api-access-w8rwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:54:54.166817 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.166433 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5d7a63a-5cec-4904-bc13-be87ff032e93-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c5d7a63a-5cec-4904-bc13-be87ff032e93" (UID: "c5d7a63a-5cec-4904-bc13-be87ff032e93"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 03:54:54.256337 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256281 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-installation-pull-secrets\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.256337 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256333 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c5d7a63a-5cec-4904-bc13-be87ff032e93-ca-trust-extracted\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.256337 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256343 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-bound-sa-token\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.256575 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256352 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-tls\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.256575 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256362 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-registry-certificates\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.256575 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256370 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8rwl\" (UniqueName: \"kubernetes.io/projected/c5d7a63a-5cec-4904-bc13-be87ff032e93-kube-api-access-w8rwl\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.260378 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256713 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c5d7a63a-5cec-4904-bc13-be87ff032e93-image-registry-private-configuration\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.260378 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.256739 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5d7a63a-5cec-4904-bc13-be87ff032e93-trusted-ca\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:54:54.940913 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.940879 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" event={"ID":"c5d7a63a-5cec-4904-bc13-be87ff032e93","Type":"ContainerDied","Data":"c694cd3ff36f4192b934e4e7ba90ed3f59d7816459caa38744b491aff332d96c"} Jul 18 03:54:54.941327 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.940955 2583 scope.go:117] "RemoveContainer" containerID="e65b3f5daccfac6f5331595496aef3e36534acb017b16df9ba53d903ce86804e" Jul 18 03:54:54.941327 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.940893 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-656fd4c5b5-wdps8" Jul 18 03:54:54.960239 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.960217 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-656fd4c5b5-wdps8"] Jul 18 03:54:54.963333 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:54.963310 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-656fd4c5b5-wdps8"] Jul 18 03:54:56.036453 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:56.036421 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" path="/var/lib/kubelet/pods/c5d7a63a-5cec-4904-bc13-be87ff032e93/volumes" Jul 18 03:54:58.032596 ip-10-0-133-144 kubenswrapper[2583]: E0718 03:54:58.032553 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gdzq9" podUID="41787ee1-0ac0-4a06-a47e-9db479999abd" Jul 18 03:54:59.581499 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:59.581462 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:59.581992 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:59.581522 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:54:59.582986 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:59.582960 2583 patch_prober.go:28] interesting pod/console-766497bcc7-4ktkk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 18 03:54:59.583117 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:59.583018 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-766497bcc7-4ktkk" podUID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 18 03:54:59.921322 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:54:59.921271 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7887m" Jul 18 03:55:01.925679 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:01.925653 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 03:55:04.891521 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:04.891488 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766497bcc7-4ktkk"] Jul 18 03:55:07.366647 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:07.366614 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:55:07.367030 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:07.366675 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:55:09.031391 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:09.031353 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:55:25.046322 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:25.046277 2583 generic.go:356] "Generic (PLEG): container finished" podID="a76197cf-e6c9-4336-875a-ff3050804f72" containerID="2af9d1495a3452e9125935d942743e6cbedec0b1bab7702d2d4f7bd9546c1a90" exitCode=0 Jul 18 03:55:25.046684 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:25.046351 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" event={"ID":"a76197cf-e6c9-4336-875a-ff3050804f72","Type":"ContainerDied","Data":"2af9d1495a3452e9125935d942743e6cbedec0b1bab7702d2d4f7bd9546c1a90"} Jul 18 03:55:25.046725 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:25.046694 2583 scope.go:117] "RemoveContainer" containerID="2af9d1495a3452e9125935d942743e6cbedec0b1bab7702d2d4f7bd9546c1a90" Jul 18 03:55:26.051692 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:26.051655 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-q8fq6" event={"ID":"a76197cf-e6c9-4336-875a-ff3050804f72","Type":"ContainerStarted","Data":"c7b7be40b3eb12d3910ec6915a55e09fb500cf0535605786f2a73a9a80c31998"} Jul 18 03:55:27.372855 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:27.372826 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:55:27.376573 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:27.376552 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6ffb887499-4jxvc" Jul 18 03:55:29.911443 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:29.911391 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-766497bcc7-4ktkk" podUID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" containerName="console" containerID="cri-o://517a1e4c7c687434d186b42e08208827cc34d972a78d863ebff8ec8a3a12d8df" gracePeriod=15 Jul 18 03:55:30.068366 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.068327 2583 generic.go:356] "Generic (PLEG): container finished" podID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" containerID="517a1e4c7c687434d186b42e08208827cc34d972a78d863ebff8ec8a3a12d8df" exitCode=0 Jul 18 03:55:30.068536 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.068368 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766497bcc7-4ktkk" event={"ID":"98781c8d-3cf5-4d1c-b79c-e54ca905de50","Type":"ContainerDied","Data":"517a1e4c7c687434d186b42e08208827cc34d972a78d863ebff8ec8a3a12d8df"} Jul 18 03:55:30.069990 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.069967 2583 generic.go:356] "Generic (PLEG): container finished" podID="9fad5863-e66b-4106-bed7-798fb78ff330" containerID="3102f9d5f5a89d9c506ee432da3dcee696793c9b8b1777c8fdc1f7bc3d7e6ea6" exitCode=0 Jul 18 03:55:30.070118 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.070025 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" event={"ID":"9fad5863-e66b-4106-bed7-798fb78ff330","Type":"ContainerDied","Data":"3102f9d5f5a89d9c506ee432da3dcee696793c9b8b1777c8fdc1f7bc3d7e6ea6"} Jul 18 03:55:30.070422 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.070406 2583 scope.go:117] "RemoveContainer" containerID="3102f9d5f5a89d9c506ee432da3dcee696793c9b8b1777c8fdc1f7bc3d7e6ea6" Jul 18 03:55:30.186335 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.186311 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:55:30.254161 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254120 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-service-ca\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254206 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-config\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254238 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-oauth-config\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254267 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-oauth-serving-cert\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254322 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-serving-cert\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254352 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-trusted-ca-bundle\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254632 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254381 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cv5l\" (UniqueName: \"kubernetes.io/projected/98781c8d-3cf5-4d1c-b79c-e54ca905de50-kube-api-access-7cv5l\") pod \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\" (UID: \"98781c8d-3cf5-4d1c-b79c-e54ca905de50\") " Jul 18 03:55:30.254689 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254651 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-config" (OuterVolumeSpecName: "console-config") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:30.254689 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254665 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-service-ca" (OuterVolumeSpecName: "service-ca") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:30.254788 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254717 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:30.254912 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.254880 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 03:55:30.256787 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.256760 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98781c8d-3cf5-4d1c-b79c-e54ca905de50-kube-api-access-7cv5l" (OuterVolumeSpecName: "kube-api-access-7cv5l") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "kube-api-access-7cv5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 03:55:30.256874 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.256804 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:30.256874 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.256818 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98781c8d-3cf5-4d1c-b79c-e54ca905de50" (UID: "98781c8d-3cf5-4d1c-b79c-e54ca905de50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 03:55:30.355785 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355744 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-config\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:30.355785 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355782 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-oauth-config\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:30.356037 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355798 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-oauth-serving-cert\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:30.356037 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355813 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98781c8d-3cf5-4d1c-b79c-e54ca905de50-console-serving-cert\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:30.356037 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355827 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-trusted-ca-bundle\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:30.356037 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355840 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cv5l\" (UniqueName: \"kubernetes.io/projected/98781c8d-3cf5-4d1c-b79c-e54ca905de50-kube-api-access-7cv5l\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:30.356037 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:30.355853 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98781c8d-3cf5-4d1c-b79c-e54ca905de50-service-ca\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 03:55:31.075010 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:31.074970 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-sjz9b" event={"ID":"9fad5863-e66b-4106-bed7-798fb78ff330","Type":"ContainerStarted","Data":"58b4b7f9fc9c128c7174aa7c8fb2ebd975498df67f6d1df0f9398b07a6a1319a"} Jul 18 03:55:31.076236 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:31.076219 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-766497bcc7-4ktkk" Jul 18 03:55:31.076324 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:31.076217 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-766497bcc7-4ktkk" event={"ID":"98781c8d-3cf5-4d1c-b79c-e54ca905de50","Type":"ContainerDied","Data":"aaae1e6a4c894d03fe1e63998ca4acda634d02b27ed4a6f238a4a7a6a3a4c42e"} Jul 18 03:55:31.076370 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:31.076360 2583 scope.go:117] "RemoveContainer" containerID="517a1e4c7c687434d186b42e08208827cc34d972a78d863ebff8ec8a3a12d8df" Jul 18 03:55:31.102075 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:31.102045 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-766497bcc7-4ktkk"] Jul 18 03:55:31.107059 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:31.107029 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-766497bcc7-4ktkk"] Jul 18 03:55:32.036088 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:55:32.036054 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" path="/var/lib/kubelet/pods/98781c8d-3cf5-4d1c-b79c-e54ca905de50/volumes" Jul 18 03:56:07.621291 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621260 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665d4fc7f4-4bnjk"] Jul 18 03:56:07.621711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621535 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerName="registry" Jul 18 03:56:07.621711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621546 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerName="registry" Jul 18 03:56:07.621711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621570 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" containerName="console" Jul 18 03:56:07.621711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621575 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" containerName="console" Jul 18 03:56:07.621711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621615 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d7a63a-5cec-4904-bc13-be87ff032e93" containerName="registry" Jul 18 03:56:07.621711 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.621623 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="98781c8d-3cf5-4d1c-b79c-e54ca905de50" containerName="console" Jul 18 03:56:07.625377 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.625357 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.627416 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.627390 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 03:56:07.627554 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.627435 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 03:56:07.627633 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.627557 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 03:56:07.628255 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.628238 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 03:56:07.628382 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.628273 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 03:56:07.628382 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.628328 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 03:56:07.628539 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.628523 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 03:56:07.629162 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.629145 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-94tc7\"" Jul 18 03:56:07.631940 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.631918 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 03:56:07.637623 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.637600 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665d4fc7f4-4bnjk"] Jul 18 03:56:07.733651 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733616 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-oauth-serving-cert\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.733838 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733705 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-trusted-ca-bundle\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.733838 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733739 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-oauth-config\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.733838 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-config\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.733838 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733803 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-service-ca\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.733838 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733823 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4644r\" (UniqueName: \"kubernetes.io/projected/02b8d25e-9fd6-48a7-932c-23d9126077fe-kube-api-access-4644r\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.734024 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.733893 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-serving-cert\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835134 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835100 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4644r\" (UniqueName: \"kubernetes.io/projected/02b8d25e-9fd6-48a7-932c-23d9126077fe-kube-api-access-4644r\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835346 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835140 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-serving-cert\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835346 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-oauth-serving-cert\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835346 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835211 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-trusted-ca-bundle\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835346 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835230 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-oauth-config\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835346 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-config\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.835346 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.835267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-service-ca\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.836142 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.836116 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-trusted-ca-bundle\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.836245 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.836124 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-service-ca\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.836245 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.836128 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-oauth-serving-cert\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.836245 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.836217 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-config\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.837629 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.837610 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-oauth-config\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.837751 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.837734 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-serving-cert\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.842597 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.842575 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4644r\" (UniqueName: \"kubernetes.io/projected/02b8d25e-9fd6-48a7-932c-23d9126077fe-kube-api-access-4644r\") pod \"console-665d4fc7f4-4bnjk\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:07.935622 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:07.935590 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:08.059980 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:08.059949 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665d4fc7f4-4bnjk"] Jul 18 03:56:08.063465 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:56:08.063433 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b8d25e_9fd6_48a7_932c_23d9126077fe.slice/crio-f0df8f894ecc782ac9a67efc999150b065ef9f424dec4a48c1a9a2a142f8ab1b WatchSource:0}: Error finding container f0df8f894ecc782ac9a67efc999150b065ef9f424dec4a48c1a9a2a142f8ab1b: Status 404 returned error can't find the container with id f0df8f894ecc782ac9a67efc999150b065ef9f424dec4a48c1a9a2a142f8ab1b Jul 18 03:56:08.204577 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:08.204492 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d4fc7f4-4bnjk" event={"ID":"02b8d25e-9fd6-48a7-932c-23d9126077fe","Type":"ContainerStarted","Data":"0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11"} Jul 18 03:56:08.204577 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:08.204546 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d4fc7f4-4bnjk" event={"ID":"02b8d25e-9fd6-48a7-932c-23d9126077fe","Type":"ContainerStarted","Data":"f0df8f894ecc782ac9a67efc999150b065ef9f424dec4a48c1a9a2a142f8ab1b"} Jul 18 03:56:08.221144 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:08.221074 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665d4fc7f4-4bnjk" podStartSLOduration=1.221060974 podStartE2EDuration="1.221060974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:56:08.220042606 +0000 UTC m=+366.732410185" watchObservedRunningTime="2026-07-18 03:56:08.221060974 +0000 UTC m=+366.733428515" Jul 18 03:56:15.995145 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:15.995109 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:56:15.997314 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:15.997282 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41787ee1-0ac0-4a06-a47e-9db479999abd-metrics-certs\") pod \"network-metrics-daemon-gdzq9\" (UID: \"41787ee1-0ac0-4a06-a47e-9db479999abd\") " pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:56:16.236560 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:16.236531 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g4mng\"" Jul 18 03:56:16.242708 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:16.242694 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gdzq9" Jul 18 03:56:16.366656 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:16.366505 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gdzq9"] Jul 18 03:56:16.369256 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:56:16.369226 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41787ee1_0ac0_4a06_a47e_9db479999abd.slice/crio-34de7b01e216e8e53e53fac3401daf0fdab661106f0fcf2e56bf72f4a6ea2ff9 WatchSource:0}: Error finding container 34de7b01e216e8e53e53fac3401daf0fdab661106f0fcf2e56bf72f4a6ea2ff9: Status 404 returned error can't find the container with id 34de7b01e216e8e53e53fac3401daf0fdab661106f0fcf2e56bf72f4a6ea2ff9 Jul 18 03:56:16.371094 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:16.371075 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 03:56:17.238592 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:17.238565 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gdzq9" event={"ID":"41787ee1-0ac0-4a06-a47e-9db479999abd","Type":"ContainerStarted","Data":"34de7b01e216e8e53e53fac3401daf0fdab661106f0fcf2e56bf72f4a6ea2ff9"} Jul 18 03:56:17.936339 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:17.936286 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:17.936510 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:17.936356 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:17.940815 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:17.940792 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:18.243763 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:18.243683 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gdzq9" event={"ID":"41787ee1-0ac0-4a06-a47e-9db479999abd","Type":"ContainerStarted","Data":"e94cdcc53ecc1c45366d4969f26f62aeb013cb6e7adf38f51b13ce469a26705b"} Jul 18 03:56:18.243763 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:18.243734 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gdzq9" event={"ID":"41787ee1-0ac0-4a06-a47e-9db479999abd","Type":"ContainerStarted","Data":"a97f0ebbe81546b57eff53421dc466de6479757fdb8973fd00adfbfebfb7fedb"} Jul 18 03:56:18.247759 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:18.247739 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 03:56:18.260067 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:56:18.260025 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gdzq9" podStartSLOduration=375.436846312 podStartE2EDuration="6m16.260011756s" totalImagesPullingTime="823.165444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:56:18.258097234 +0000 UTC m=+376.770464773" watchObservedRunningTime="2026-07-18 03:56:18.260011756 +0000 UTC m=+376.772379296" Jul 18 03:57:28.527483 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.527407 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sjf8x"] Jul 18 03:57:28.530464 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.530448 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.533435 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.533417 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 03:57:28.533538 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.533501 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dbdj8\"" Jul 18 03:57:28.534268 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.534253 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 03:57:28.539836 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.539814 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sjf8x"] Jul 18 03:57:28.619978 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.619937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/986f9007-c0d8-42a5-bdba-a3abcf0811ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sjf8x\" (UID: \"986f9007-c0d8-42a5-bdba-a3abcf0811ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.620120 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.620053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2p5x\" (UniqueName: \"kubernetes.io/projected/986f9007-c0d8-42a5-bdba-a3abcf0811ec-kube-api-access-b2p5x\") pod \"cert-manager-webhook-6486ffd997-sjf8x\" (UID: \"986f9007-c0d8-42a5-bdba-a3abcf0811ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.721276 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.721238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/986f9007-c0d8-42a5-bdba-a3abcf0811ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sjf8x\" (UID: \"986f9007-c0d8-42a5-bdba-a3abcf0811ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.721432 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.721292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2p5x\" (UniqueName: \"kubernetes.io/projected/986f9007-c0d8-42a5-bdba-a3abcf0811ec-kube-api-access-b2p5x\") pod \"cert-manager-webhook-6486ffd997-sjf8x\" (UID: \"986f9007-c0d8-42a5-bdba-a3abcf0811ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.728683 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.728656 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/986f9007-c0d8-42a5-bdba-a3abcf0811ec-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sjf8x\" (UID: \"986f9007-c0d8-42a5-bdba-a3abcf0811ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.728809 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.728794 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2p5x\" (UniqueName: \"kubernetes.io/projected/986f9007-c0d8-42a5-bdba-a3abcf0811ec-kube-api-access-b2p5x\") pod \"cert-manager-webhook-6486ffd997-sjf8x\" (UID: \"986f9007-c0d8-42a5-bdba-a3abcf0811ec\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.852349 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.852277 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:28.975457 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:28.975429 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sjf8x"] Jul 18 03:57:28.979020 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:57:28.978992 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod986f9007_c0d8_42a5_bdba_a3abcf0811ec.slice/crio-18e90f1621d7b858549cf9e2a56e5e32d8bd87e2b6ac1689261a196c2dbfe167 WatchSource:0}: Error finding container 18e90f1621d7b858549cf9e2a56e5e32d8bd87e2b6ac1689261a196c2dbfe167: Status 404 returned error can't find the container with id 18e90f1621d7b858549cf9e2a56e5e32d8bd87e2b6ac1689261a196c2dbfe167 Jul 18 03:57:29.494842 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:29.494794 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" event={"ID":"986f9007-c0d8-42a5-bdba-a3abcf0811ec","Type":"ContainerStarted","Data":"18e90f1621d7b858549cf9e2a56e5e32d8bd87e2b6ac1689261a196c2dbfe167"} Jul 18 03:57:32.508407 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:32.508371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" event={"ID":"986f9007-c0d8-42a5-bdba-a3abcf0811ec","Type":"ContainerStarted","Data":"48c80c1306415e4998c5e3484d961ee6ff73d9e014aea148077fa4159d12ffc3"} Jul 18 03:57:32.508872 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:32.508478 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:32.526925 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:32.526880 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" podStartSLOduration=1.560809527 podStartE2EDuration="4.526865672s" totalImagesPullingTime="2.966056145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:57:32.525049165 +0000 UTC m=+451.037416707" watchObservedRunningTime="2026-07-18 03:57:32.526865672 +0000 UTC m=+451.039233213" Jul 18 03:57:38.514001 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:38.513971 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sjf8x" Jul 18 03:57:46.650764 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.650729 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tkc5l"] Jul 18 03:57:46.653960 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.653940 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.655962 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.655945 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8rcmj\"" Jul 18 03:57:46.662997 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.662977 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tkc5l"] Jul 18 03:57:46.761306 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.761275 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca276861-2fa0-4ede-8c7e-800ab173c43d-bound-sa-token\") pod \"cert-manager-55b4d954d5-tkc5l\" (UID: \"ca276861-2fa0-4ede-8c7e-800ab173c43d\") " pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.761486 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.761413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7sf\" (UniqueName: \"kubernetes.io/projected/ca276861-2fa0-4ede-8c7e-800ab173c43d-kube-api-access-jm7sf\") pod \"cert-manager-55b4d954d5-tkc5l\" (UID: \"ca276861-2fa0-4ede-8c7e-800ab173c43d\") " pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.862009 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.861975 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7sf\" (UniqueName: \"kubernetes.io/projected/ca276861-2fa0-4ede-8c7e-800ab173c43d-kube-api-access-jm7sf\") pod \"cert-manager-55b4d954d5-tkc5l\" (UID: \"ca276861-2fa0-4ede-8c7e-800ab173c43d\") " pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.862158 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.862023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca276861-2fa0-4ede-8c7e-800ab173c43d-bound-sa-token\") pod \"cert-manager-55b4d954d5-tkc5l\" (UID: \"ca276861-2fa0-4ede-8c7e-800ab173c43d\") " pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.870429 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.870402 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca276861-2fa0-4ede-8c7e-800ab173c43d-bound-sa-token\") pod \"cert-manager-55b4d954d5-tkc5l\" (UID: \"ca276861-2fa0-4ede-8c7e-800ab173c43d\") " pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.870529 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.870475 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7sf\" (UniqueName: \"kubernetes.io/projected/ca276861-2fa0-4ede-8c7e-800ab173c43d-kube-api-access-jm7sf\") pod \"cert-manager-55b4d954d5-tkc5l\" (UID: \"ca276861-2fa0-4ede-8c7e-800ab173c43d\") " pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:46.962856 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:46.962825 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tkc5l" Jul 18 03:57:47.089049 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:47.089018 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tkc5l"] Jul 18 03:57:47.092033 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:57:47.092007 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca276861_2fa0_4ede_8c7e_800ab173c43d.slice/crio-36dbcec5838c08b623e0d7ab7243c70d6b8a4993d0c8cf1be3ab0d6634de50e7 WatchSource:0}: Error finding container 36dbcec5838c08b623e0d7ab7243c70d6b8a4993d0c8cf1be3ab0d6634de50e7: Status 404 returned error can't find the container with id 36dbcec5838c08b623e0d7ab7243c70d6b8a4993d0c8cf1be3ab0d6634de50e7 Jul 18 03:57:47.563209 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:47.563176 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tkc5l" event={"ID":"ca276861-2fa0-4ede-8c7e-800ab173c43d","Type":"ContainerStarted","Data":"ffee5b353a25f59c7e61fb260b28be715e5f89641c40147d59281e8f1d47f11e"} Jul 18 03:57:47.563209 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:47.563216 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tkc5l" event={"ID":"ca276861-2fa0-4ede-8c7e-800ab173c43d","Type":"ContainerStarted","Data":"36dbcec5838c08b623e0d7ab7243c70d6b8a4993d0c8cf1be3ab0d6634de50e7"} Jul 18 03:57:47.577496 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:47.577447 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tkc5l" podStartSLOduration=1.577429194 podStartE2EDuration="1.577429194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:57:47.576376595 +0000 UTC m=+466.088744136" watchObservedRunningTime="2026-07-18 03:57:47.577429194 +0000 UTC m=+466.089796735" Jul 18 03:57:59.144716 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.144682 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq"] Jul 18 03:57:59.148038 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.148015 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.152008 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.151983 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 03:57:59.152132 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.152080 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 03:57:59.152217 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.152198 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 03:57:59.152567 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.152548 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l7xz5\"" Jul 18 03:57:59.152636 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.152601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 03:57:59.167673 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.167650 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq"] Jul 18 03:57:59.261847 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.261814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4z5l\" (UniqueName: \"kubernetes.io/projected/09e80bbb-b623-42bf-9ee9-aa90cb24493e-kube-api-access-s4z5l\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.262022 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.261873 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/09e80bbb-b623-42bf-9ee9-aa90cb24493e-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.262022 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.261891 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e80bbb-b623-42bf-9ee9-aa90cb24493e-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.262022 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.261933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09e80bbb-b623-42bf-9ee9-aa90cb24493e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.262128 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.262044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09e80bbb-b623-42bf-9ee9-aa90cb24493e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.363373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.363337 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/09e80bbb-b623-42bf-9ee9-aa90cb24493e-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.363373 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.363373 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e80bbb-b623-42bf-9ee9-aa90cb24493e-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.363609 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.363396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09e80bbb-b623-42bf-9ee9-aa90cb24493e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.363609 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.363435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09e80bbb-b623-42bf-9ee9-aa90cb24493e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.363609 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.363497 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4z5l\" (UniqueName: \"kubernetes.io/projected/09e80bbb-b623-42bf-9ee9-aa90cb24493e-kube-api-access-s4z5l\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.363822 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.363796 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/09e80bbb-b623-42bf-9ee9-aa90cb24493e-manifests\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.365820 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.365790 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e80bbb-b623-42bf-9ee9-aa90cb24493e-tmp\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.365990 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.365967 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09e80bbb-b623-42bf-9ee9-aa90cb24493e-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.366051 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.365998 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09e80bbb-b623-42bf-9ee9-aa90cb24493e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.370772 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.370749 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4z5l\" (UniqueName: \"kubernetes.io/projected/09e80bbb-b623-42bf-9ee9-aa90cb24493e-kube-api-access-s4z5l\") pod \"opendatahub-operator-controller-manager-5f994c8d8-kwctq\" (UID: \"09e80bbb-b623-42bf-9ee9-aa90cb24493e\") " pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.458494 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.458461 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:57:59.588350 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.588321 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq"] Jul 18 03:57:59.590946 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:57:59.590911 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e80bbb_b623_42bf_9ee9_aa90cb24493e.slice/crio-687cb9393eb25ec7c924409b173b9ed6be4c9a11316441316eee01ce93f6b883 WatchSource:0}: Error finding container 687cb9393eb25ec7c924409b173b9ed6be4c9a11316441316eee01ce93f6b883: Status 404 returned error can't find the container with id 687cb9393eb25ec7c924409b173b9ed6be4c9a11316441316eee01ce93f6b883 Jul 18 03:57:59.614101 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:57:59.614074 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" event={"ID":"09e80bbb-b623-42bf-9ee9-aa90cb24493e","Type":"ContainerStarted","Data":"687cb9393eb25ec7c924409b173b9ed6be4c9a11316441316eee01ce93f6b883"} Jul 18 03:58:02.630574 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:02.630538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" event={"ID":"09e80bbb-b623-42bf-9ee9-aa90cb24493e","Type":"ContainerStarted","Data":"970487f9eb77cf1c408ab1faf0ab6b631de0b6ea61941cb3fe6a13e69810dfc9"} Jul 18 03:58:03.636002 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:03.635977 2583 generic.go:356] "Generic (PLEG): container finished" podID="09e80bbb-b623-42bf-9ee9-aa90cb24493e" containerID="970487f9eb77cf1c408ab1faf0ab6b631de0b6ea61941cb3fe6a13e69810dfc9" exitCode=0 Jul 18 03:58:03.636327 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:03.636013 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" event={"ID":"09e80bbb-b623-42bf-9ee9-aa90cb24493e","Type":"ContainerDied","Data":"970487f9eb77cf1c408ab1faf0ab6b631de0b6ea61941cb3fe6a13e69810dfc9"} Jul 18 03:58:04.643031 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:04.642999 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" event={"ID":"09e80bbb-b623-42bf-9ee9-aa90cb24493e","Type":"ContainerStarted","Data":"9ca67af9c309e15ec75995c6f31a1c21ca822fa4539b98f41f5102a5fb8d7b1a"} Jul 18 03:58:04.643442 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:04.643133 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:58:04.662423 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:04.662364 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" podStartSLOduration=1.341045576 podStartE2EDuration="5.662344772s" totalImagesPullingTime="3.31268378s" totalInitContainerRuntime="1.008615416s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:57:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:04.661356783 +0000 UTC m=+483.173724339" watchObservedRunningTime="2026-07-18 03:58:04.662344772 +0000 UTC m=+483.174712313" Jul 18 03:58:15.648837 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:15.648806 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f994c8d8-kwctq" Jul 18 03:58:19.153087 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.153044 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-86fl2"] Jul 18 03:58:19.163701 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.163673 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.164065 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.164036 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-86fl2"] Jul 18 03:58:19.166044 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.166022 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-t9whc\"" Jul 18 03:58:19.166159 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.166023 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 18 03:58:19.217152 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.217124 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdh8b\" (UniqueName: \"kubernetes.io/projected/bc87efd8-cdd4-4c06-b707-56dcfeb7b963-kube-api-access-bdh8b\") pod \"model-serving-api-54d89bd5fc-86fl2\" (UID: \"bc87efd8-cdd4-4c06-b707-56dcfeb7b963\") " pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.217285 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.217158 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc87efd8-cdd4-4c06-b707-56dcfeb7b963-tls-certs\") pod \"model-serving-api-54d89bd5fc-86fl2\" (UID: \"bc87efd8-cdd4-4c06-b707-56dcfeb7b963\") " pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.317958 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.317916 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdh8b\" (UniqueName: \"kubernetes.io/projected/bc87efd8-cdd4-4c06-b707-56dcfeb7b963-kube-api-access-bdh8b\") pod \"model-serving-api-54d89bd5fc-86fl2\" (UID: \"bc87efd8-cdd4-4c06-b707-56dcfeb7b963\") " pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.318137 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.317969 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc87efd8-cdd4-4c06-b707-56dcfeb7b963-tls-certs\") pod \"model-serving-api-54d89bd5fc-86fl2\" (UID: \"bc87efd8-cdd4-4c06-b707-56dcfeb7b963\") " pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.320508 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.320482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc87efd8-cdd4-4c06-b707-56dcfeb7b963-tls-certs\") pod \"model-serving-api-54d89bd5fc-86fl2\" (UID: \"bc87efd8-cdd4-4c06-b707-56dcfeb7b963\") " pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.325693 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.325634 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdh8b\" (UniqueName: \"kubernetes.io/projected/bc87efd8-cdd4-4c06-b707-56dcfeb7b963-kube-api-access-bdh8b\") pod \"model-serving-api-54d89bd5fc-86fl2\" (UID: \"bc87efd8-cdd4-4c06-b707-56dcfeb7b963\") " pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.475410 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.475335 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:19.679498 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.679449 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf"] Jul 18 03:58:19.683903 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.683881 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.687925 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.687901 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 03:58:19.688053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.687955 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-45xn5\"" Jul 18 03:58:19.688053 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.687979 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 03:58:19.688334 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.688314 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 03:58:19.688334 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.688324 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 03:58:19.688495 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.688384 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 03:58:19.700089 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.700069 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf"] Jul 18 03:58:19.720369 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.720348 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85134b6a-f2d7-4be2-8c7e-ab75491415b9-manager-config\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.720469 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.720390 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhpz2\" (UniqueName: \"kubernetes.io/projected/85134b6a-f2d7-4be2-8c7e-ab75491415b9-kube-api-access-vhpz2\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.720529 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.720475 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85134b6a-f2d7-4be2-8c7e-ab75491415b9-metrics-cert\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.720597 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.720573 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85134b6a-f2d7-4be2-8c7e-ab75491415b9-cert\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.821526 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.821456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85134b6a-f2d7-4be2-8c7e-ab75491415b9-manager-config\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.821526 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.821495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhpz2\" (UniqueName: \"kubernetes.io/projected/85134b6a-f2d7-4be2-8c7e-ab75491415b9-kube-api-access-vhpz2\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.821741 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.821536 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85134b6a-f2d7-4be2-8c7e-ab75491415b9-metrics-cert\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.821741 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.821563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85134b6a-f2d7-4be2-8c7e-ab75491415b9-cert\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.822254 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.822226 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/85134b6a-f2d7-4be2-8c7e-ab75491415b9-manager-config\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.824097 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.824073 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/85134b6a-f2d7-4be2-8c7e-ab75491415b9-metrics-cert\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.824195 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.824108 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85134b6a-f2d7-4be2-8c7e-ab75491415b9-cert\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.828697 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.828674 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhpz2\" (UniqueName: \"kubernetes.io/projected/85134b6a-f2d7-4be2-8c7e-ab75491415b9-kube-api-access-vhpz2\") pod \"lws-controller-manager-6df5b785c7-5g2zf\" (UID: \"85134b6a-f2d7-4be2-8c7e-ab75491415b9\") " pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:19.834038 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.834017 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-86fl2"] Jul 18 03:58:19.837169 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:58:19.837146 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc87efd8_cdd4_4c06_b707_56dcfeb7b963.slice/crio-ad5f4bf3eba1ff418a89ca15aea3b3a2c97ca16d79eb22c229ddd1e6c9e0870a WatchSource:0}: Error finding container ad5f4bf3eba1ff418a89ca15aea3b3a2c97ca16d79eb22c229ddd1e6c9e0870a: Status 404 returned error can't find the container with id ad5f4bf3eba1ff418a89ca15aea3b3a2c97ca16d79eb22c229ddd1e6c9e0870a Jul 18 03:58:19.994999 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:19.994963 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:20.136177 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:20.136147 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf"] Jul 18 03:58:20.139154 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:58:20.139124 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85134b6a_f2d7_4be2_8c7e_ab75491415b9.slice/crio-82318eb6f95f77404c58ce59fe1b4c22c9d84c484953588c5802e30e28e68000 WatchSource:0}: Error finding container 82318eb6f95f77404c58ce59fe1b4c22c9d84c484953588c5802e30e28e68000: Status 404 returned error can't find the container with id 82318eb6f95f77404c58ce59fe1b4c22c9d84c484953588c5802e30e28e68000 Jul 18 03:58:20.719720 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:20.719681 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" event={"ID":"bc87efd8-cdd4-4c06-b707-56dcfeb7b963","Type":"ContainerStarted","Data":"ad5f4bf3eba1ff418a89ca15aea3b3a2c97ca16d79eb22c229ddd1e6c9e0870a"} Jul 18 03:58:20.721120 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:20.721091 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" event={"ID":"85134b6a-f2d7-4be2-8c7e-ab75491415b9","Type":"ContainerStarted","Data":"82318eb6f95f77404c58ce59fe1b4c22c9d84c484953588c5802e30e28e68000"} Jul 18 03:58:23.738323 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:23.738266 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" event={"ID":"bc87efd8-cdd4-4c06-b707-56dcfeb7b963","Type":"ContainerStarted","Data":"925e9f79f77949db87964b4ee6d75b2740ffb784d5d19539ebd43497025608e5"} Jul 18 03:58:23.738777 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:23.738360 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 03:58:23.739957 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:23.739919 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" event={"ID":"85134b6a-f2d7-4be2-8c7e-ab75491415b9","Type":"ContainerStarted","Data":"a5aa736a9fb017e27a7765df0c417d340e7f2716e2cbbf3a7ddff150c828b36b"} Jul 18 03:58:23.740084 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:23.739984 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:23.755102 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:23.755053 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" podStartSLOduration=2.9462765539999998 podStartE2EDuration="4.755039761s" totalImagesPullingTime="1.808763207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:23.753917616 +0000 UTC m=+502.266285169" watchObservedRunningTime="2026-07-18 03:58:23.755039761 +0000 UTC m=+502.267407301" Jul 18 03:58:23.770241 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:23.770200 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" podStartSLOduration=2.162594712 podStartE2EDuration="4.7701885s" totalImagesPullingTime="2.607593788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:23.769015614 +0000 UTC m=+502.281383177" watchObservedRunningTime="2026-07-18 03:58:23.7701885 +0000 UTC m=+502.282556041" Jul 18 03:58:25.653721 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.653692 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn"] Jul 18 03:58:25.656839 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.656817 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.658998 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.658965 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gzjf9\"" Jul 18 03:58:25.658998 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.658966 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 03:58:25.673568 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.673546 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn"] Jul 18 03:58:25.778005 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.777974 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.778151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778023 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4262e01e-c4c9-4327-8f16-8d8f4396f930-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.778151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778054 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thcrb\" (UniqueName: \"kubernetes.io/projected/4262e01e-c4c9-4327-8f16-8d8f4396f930-kube-api-access-thcrb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.778151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778076 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.778151 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778109 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.778575 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.783150 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778789 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.783150 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778851 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.783150 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.778882 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.879863 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.879825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880032 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.879894 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880032 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.879926 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880032 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.879972 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880032 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.879995 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880032 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880026 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880286 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880067 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4262e01e-c4c9-4327-8f16-8d8f4396f930-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880286 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880104 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thcrb\" (UniqueName: \"kubernetes.io/projected/4262e01e-c4c9-4327-8f16-8d8f4396f930-kube-api-access-thcrb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880286 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880480 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880340 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880611 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880683 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.880683 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.880640 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.881038 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.881012 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4262e01e-c4c9-4327-8f16-8d8f4396f930-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.882395 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.882376 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.882742 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.882715 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.887989 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.887969 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4262e01e-c4c9-4327-8f16-8d8f4396f930-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.888257 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.888241 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thcrb\" (UniqueName: \"kubernetes.io/projected/4262e01e-c4c9-4327-8f16-8d8f4396f930-kube-api-access-thcrb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4c59tn\" (UID: \"4262e01e-c4c9-4327-8f16-8d8f4396f930\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:25.966522 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:25.966462 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:26.099727 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:26.099704 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn"] Jul 18 03:58:26.101579 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:58:26.101551 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4262e01e_c4c9_4327_8f16_8d8f4396f930.slice/crio-f63abeb0f082f3244334e30c2de6b08ce134476d204eec674f3d3b0a839a405d WatchSource:0}: Error finding container f63abeb0f082f3244334e30c2de6b08ce134476d204eec674f3d3b0a839a405d: Status 404 returned error can't find the container with id f63abeb0f082f3244334e30c2de6b08ce134476d204eec674f3d3b0a839a405d Jul 18 03:58:26.754973 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:26.754927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" event={"ID":"4262e01e-c4c9-4327-8f16-8d8f4396f930","Type":"ContainerStarted","Data":"f63abeb0f082f3244334e30c2de6b08ce134476d204eec674f3d3b0a839a405d"} Jul 18 03:58:27.269562 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.269510 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf"] Jul 18 03:58:27.273391 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.273366 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.299054 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.299028 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf"] Jul 18 03:58:27.306888 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.306825 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kctdz\"" Jul 18 03:58:27.307398 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.307349 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 18 03:58:27.314640 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.314465 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 18 03:58:27.314640 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.314536 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 18 03:58:27.392626 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.392805 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392670 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.392805 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392718 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.392805 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392750 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.392805 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.393005 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392809 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2m64\" (UniqueName: \"kubernetes.io/projected/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-kube-api-access-b2m64\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.393005 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.392849 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2m64\" (UniqueName: \"kubernetes.io/projected/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-kube-api-access-b2m64\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494508 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494564 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.495203 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.494656 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.497923 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.497498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.500320 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.500243 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.502985 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.502949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.503460 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.503433 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.504444 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.504390 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.505291 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.505257 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.506323 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.506275 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2m64\" (UniqueName: \"kubernetes.io/projected/e6967bd8-91eb-4233-a97c-ed7f3f80e0da-kube-api-access-b2m64\") pod \"istiod-openshift-gateway-94bb8fbfd-9pgsf\" (UID: \"e6967bd8-91eb-4233-a97c-ed7f3f80e0da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.587953 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.587875 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:27.807716 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:27.807689 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf"] Jul 18 03:58:27.809884 ip-10-0-133-144 kubenswrapper[2583]: W0718 03:58:27.809852 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6967bd8_91eb_4233_a97c_ed7f3f80e0da.slice/crio-2a159e8f61ce939ed4ef2d22f007b401f1860c9687192b4183a1c986f25df95d WatchSource:0}: Error finding container 2a159e8f61ce939ed4ef2d22f007b401f1860c9687192b4183a1c986f25df95d: Status 404 returned error can't find the container with id 2a159e8f61ce939ed4ef2d22f007b401f1860c9687192b4183a1c986f25df95d Jul 18 03:58:28.768966 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:28.768918 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" event={"ID":"e6967bd8-91eb-4233-a97c-ed7f3f80e0da","Type":"ContainerStarted","Data":"2a159e8f61ce939ed4ef2d22f007b401f1860c9687192b4183a1c986f25df95d"} Jul 18 03:58:29.228374 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:29.228330 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 03:58:29.228721 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:29.228426 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 03:58:29.228721 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:29.228492 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 03:58:29.775759 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:29.775726 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" event={"ID":"4262e01e-c4c9-4327-8f16-8d8f4396f930","Type":"ContainerStarted","Data":"1c587510a34704228a1955eaf62de20e21b23b717df337a6f8d4ef7ea703eb93"} Jul 18 03:58:29.819241 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:29.818341 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" podStartSLOduration=1.693977925 podStartE2EDuration="4.818319015s" totalImagesPullingTime="3.12434109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:29.817182534 +0000 UTC m=+508.329550137" watchObservedRunningTime="2026-07-18 03:58:29.818319015 +0000 UTC m=+508.330686553" Jul 18 03:58:29.967098 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:29.967056 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:30.972978 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:30.972944 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:31.086913 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.086877 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 03:58:31.086981 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.086944 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 03:58:31.786706 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.786670 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" event={"ID":"e6967bd8-91eb-4233-a97c-ed7f3f80e0da","Type":"ContainerStarted","Data":"aa853198b072c9b9afb7ec1f52efc769d8dfb68f5477ea26ce886f0563228f21"} Jul 18 03:58:31.786986 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.786965 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:31.787072 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.787007 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:31.787963 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.787943 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4c59tn" Jul 18 03:58:31.812522 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:31.812459 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" podStartSLOduration=1.538106022 podStartE2EDuration="4.812435623s" totalImagesPullingTime="3.274329601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 03:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 03:58:31.810955513 +0000 UTC m=+510.323323082" watchObservedRunningTime="2026-07-18 03:58:31.812435623 +0000 UTC m=+510.324803165" Jul 18 03:58:32.793512 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:32.793485 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9pgsf" Jul 18 03:58:34.746091 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:34.746063 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6df5b785c7-5g2zf" Jul 18 03:58:34.747818 ip-10-0-133-144 kubenswrapper[2583]: I0718 03:58:34.747795 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-86fl2" Jul 18 04:00:09.402796 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:09.402759 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665d4fc7f4-4bnjk"] Jul 18 04:00:34.431083 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.431041 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-665d4fc7f4-4bnjk" podUID="02b8d25e-9fd6-48a7-932c-23d9126077fe" containerName="console" containerID="cri-o://0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11" gracePeriod=15 Jul 18 04:00:34.677748 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.677716 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 04:00:34.723280 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723205 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-oauth-serving-cert\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723280 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723250 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-config\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723478 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723283 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-trusted-ca-bundle\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723478 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723364 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4644r\" (UniqueName: \"kubernetes.io/projected/02b8d25e-9fd6-48a7-932c-23d9126077fe-kube-api-access-4644r\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723478 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723392 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-oauth-config\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723478 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723435 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-serving-cert\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723676 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723496 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-service-ca\") pod \"02b8d25e-9fd6-48a7-932c-23d9126077fe\" (UID: \"02b8d25e-9fd6-48a7-932c-23d9126077fe\") " Jul 18 04:00:34.723732 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723707 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 04:00:34.723859 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723828 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-config" (OuterVolumeSpecName: "console-config") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 04:00:34.723960 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723835 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 04:00:34.724024 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.723988 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 04:00:34.725536 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.725510 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02b8d25e-9fd6-48a7-932c-23d9126077fe-kube-api-access-4644r" (OuterVolumeSpecName: "kube-api-access-4644r") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "kube-api-access-4644r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 04:00:34.725647 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.725622 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 04:00:34.725702 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.725654 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02b8d25e-9fd6-48a7-932c-23d9126077fe" (UID: "02b8d25e-9fd6-48a7-932c-23d9126077fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 04:00:34.824291 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824263 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-service-ca\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:34.824291 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824287 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-oauth-serving-cert\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:34.824291 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824307 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-config\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:34.824291 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824316 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02b8d25e-9fd6-48a7-932c-23d9126077fe-trusted-ca-bundle\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:34.824595 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824324 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4644r\" (UniqueName: \"kubernetes.io/projected/02b8d25e-9fd6-48a7-932c-23d9126077fe-kube-api-access-4644r\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:34.824595 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824332 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-oauth-config\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:34.824595 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:34.824341 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02b8d25e-9fd6-48a7-932c-23d9126077fe-console-serving-cert\") on node \"ip-10-0-133-144.ec2.internal\" DevicePath \"\"" Jul 18 04:00:35.307356 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.307320 2583 generic.go:356] "Generic (PLEG): container finished" podID="02b8d25e-9fd6-48a7-932c-23d9126077fe" containerID="0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11" exitCode=0 Jul 18 04:00:35.307523 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.307362 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665d4fc7f4-4bnjk" Jul 18 04:00:35.307523 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.307391 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d4fc7f4-4bnjk" event={"ID":"02b8d25e-9fd6-48a7-932c-23d9126077fe","Type":"ContainerDied","Data":"0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11"} Jul 18 04:00:35.307523 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.307443 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665d4fc7f4-4bnjk" event={"ID":"02b8d25e-9fd6-48a7-932c-23d9126077fe","Type":"ContainerDied","Data":"f0df8f894ecc782ac9a67efc999150b065ef9f424dec4a48c1a9a2a142f8ab1b"} Jul 18 04:00:35.307523 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.307463 2583 scope.go:117] "RemoveContainer" containerID="0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11" Jul 18 04:00:35.317844 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.317820 2583 scope.go:117] "RemoveContainer" containerID="0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11" Jul 18 04:00:35.318263 ip-10-0-133-144 kubenswrapper[2583]: E0718 04:00:35.318241 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11\": container with ID starting with 0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11 not found: ID does not exist" containerID="0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11" Jul 18 04:00:35.318348 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.318270 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11"} err="failed to get container status \"0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11\": rpc error: code = NotFound desc = could not find container \"0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11\": container with ID starting with 0cd9fecc930f7bb8611867428713d2c95a1ebe641bd915998570473826620c11 not found: ID does not exist" Jul 18 04:00:35.329448 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.329414 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-665d4fc7f4-4bnjk"] Jul 18 04:00:35.332648 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:35.332622 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-665d4fc7f4-4bnjk"] Jul 18 04:00:36.036847 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:00:36.036815 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02b8d25e-9fd6-48a7-932c-23d9126077fe" path="/var/lib/kubelet/pods/02b8d25e-9fd6-48a7-932c-23d9126077fe/volumes" Jul 18 04:01:06.107626 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.107587 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn"] Jul 18 04:01:06.108017 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.107892 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02b8d25e-9fd6-48a7-932c-23d9126077fe" containerName="console" Jul 18 04:01:06.108017 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.107903 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="02b8d25e-9fd6-48a7-932c-23d9126077fe" containerName="console" Jul 18 04:01:06.108017 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.107964 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="02b8d25e-9fd6-48a7-932c-23d9126077fe" containerName="console" Jul 18 04:01:06.111245 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.111224 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.113409 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.113390 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j2b2r\"" Jul 18 04:01:06.123001 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.122974 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn"] Jul 18 04:01:06.200938 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.200892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.200948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.200968 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.200984 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwhgc\" (UniqueName: \"kubernetes.io/projected/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-kube-api-access-xwhgc\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.201025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.201045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.201068 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.201084 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.201120 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.201101 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.301925 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.301893 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.301957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.301987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwhgc\" (UniqueName: \"kubernetes.io/projected/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-kube-api-access-xwhgc\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302470 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302470 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302470 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302391 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302609 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302535 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302733 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302712 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302820 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302801 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.302934 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.302912 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.304464 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.304440 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.304663 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.304646 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.309525 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.309504 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.309795 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.309776 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwhgc\" (UniqueName: \"kubernetes.io/projected/22e5fa9b-9cbe-4522-b932-5ea249d4bfba-kube-api-access-xwhgc\") pod \"maas-default-gateway-openshift-default-56654dcf7-jwpgn\" (UID: \"22e5fa9b-9cbe-4522-b932-5ea249d4bfba\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.421525 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.421490 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:06.549559 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.549533 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn"] Jul 18 04:01:06.551506 ip-10-0-133-144 kubenswrapper[2583]: W0718 04:01:06.551478 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e5fa9b_9cbe_4522_b932_5ea249d4bfba.slice/crio-473add39d3f94f3b149ff11da8086d33755bf80606dca672ec85613c4db3b623 WatchSource:0}: Error finding container 473add39d3f94f3b149ff11da8086d33755bf80606dca672ec85613c4db3b623: Status 404 returned error can't find the container with id 473add39d3f94f3b149ff11da8086d33755bf80606dca672ec85613c4db3b623 Jul 18 04:01:06.553503 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.553471 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 04:01:06.553583 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.553536 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 04:01:06.553583 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:06.553565 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 04:01:07.443779 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:07.443744 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" event={"ID":"22e5fa9b-9cbe-4522-b932-5ea249d4bfba","Type":"ContainerStarted","Data":"70f1e2ad03ba89a4d8b42953c0b5ec3c8ff27f74f36029cd1cd0f9d9cb131459"} Jul 18 04:01:07.444196 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:07.443792 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" event={"ID":"22e5fa9b-9cbe-4522-b932-5ea249d4bfba","Type":"ContainerStarted","Data":"473add39d3f94f3b149ff11da8086d33755bf80606dca672ec85613c4db3b623"} Jul 18 04:01:07.462572 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:07.462509 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" podStartSLOduration=1.462488804 podStartE2EDuration="1.462488804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:01:07.461153717 +0000 UTC m=+665.973521278" watchObservedRunningTime="2026-07-18 04:01:07.462488804 +0000 UTC m=+665.974856344" Jul 18 04:01:08.422023 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:08.421987 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:08.427089 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:08.427063 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:08.448553 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:08.448521 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:01:08.449435 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:01:08.449414 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:02:32.803007 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:32.802973 2583 generic.go:356] "Generic (PLEG): container finished" podID="22e5fa9b-9cbe-4522-b932-5ea249d4bfba" containerID="70f1e2ad03ba89a4d8b42953c0b5ec3c8ff27f74f36029cd1cd0f9d9cb131459" exitCode=0 Jul 18 04:02:32.803446 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:32.803048 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" event={"ID":"22e5fa9b-9cbe-4522-b932-5ea249d4bfba","Type":"ContainerDied","Data":"70f1e2ad03ba89a4d8b42953c0b5ec3c8ff27f74f36029cd1cd0f9d9cb131459"} Jul 18 04:02:32.803446 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:32.803406 2583 scope.go:117] "RemoveContainer" containerID="70f1e2ad03ba89a4d8b42953c0b5ec3c8ff27f74f36029cd1cd0f9d9cb131459" Jul 18 04:02:32.804292 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:32.804264 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 04:02:32.804410 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:32.804354 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 04:02:32.804410 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:32.804387 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 18 04:02:33.809774 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:33.809739 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" event={"ID":"22e5fa9b-9cbe-4522-b932-5ea249d4bfba","Type":"ContainerStarted","Data":"aa26eaa04698b30badbfc895d653c553a2dbed9a7622fc99211970fc4b81c3b2"} Jul 18 04:02:34.422578 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:34.422546 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:02:34.423544 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:34.423511 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jwpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 04:02:34.423680 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:34.423592 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" podUID="22e5fa9b-9cbe-4522-b932-5ea249d4bfba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 04:02:35.422509 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:35.422474 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jwpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 04:02:35.423155 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:35.423123 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" podUID="22e5fa9b-9cbe-4522-b932-5ea249d4bfba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 04:02:36.421931 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:36.421892 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jwpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 04:02:36.422208 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:36.422176 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" podUID="22e5fa9b-9cbe-4522-b932-5ea249d4bfba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 04:02:37.422537 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:37.422502 2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-jwpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body= Jul 18 04:02:37.423112 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:37.423081 2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" podUID="22e5fa9b-9cbe-4522-b932-5ea249d4bfba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" Jul 18 04:02:38.426441 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:38.426408 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:02:38.426818 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:38.426671 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:02:38.427399 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:38.427375 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-jwpgn" Jul 18 04:02:55.570051 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.570020 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx"] Jul 18 04:02:55.573529 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.573509 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.576344 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.576323 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 18 04:02:55.576527 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.576508 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w78lm\"" Jul 18 04:02:55.576597 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.576559 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 04:02:55.576657 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.576615 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 04:02:55.584119 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.584100 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx"] Jul 18 04:02:55.683060 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.683027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.683224 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.683095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.683224 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.683151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.683342 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.683228 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0780476-b199-47a1-97da-57501def2a82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.683342 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.683256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c65t\" (UniqueName: \"kubernetes.io/projected/e0780476-b199-47a1-97da-57501def2a82-kube-api-access-2c65t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.683342 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.683317 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784403 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784369 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784587 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0780476-b199-47a1-97da-57501def2a82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784587 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c65t\" (UniqueName: \"kubernetes.io/projected/e0780476-b199-47a1-97da-57501def2a82-kube-api-access-2c65t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784587 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784467 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784587 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784484 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784587 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784871 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784849 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784943 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784892 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.784943 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.784932 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.786806 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.786787 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0780476-b199-47a1-97da-57501def2a82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.786987 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.786968 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0780476-b199-47a1-97da-57501def2a82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.791612 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.791590 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c65t\" (UniqueName: \"kubernetes.io/projected/e0780476-b199-47a1-97da-57501def2a82-kube-api-access-2c65t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qdbzx\" (UID: \"e0780476-b199-47a1-97da-57501def2a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:55.884852 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:55.884772 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:02:56.011918 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:56.011893 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx"] Jul 18 04:02:56.014357 ip-10-0-133-144 kubenswrapper[2583]: W0718 04:02:56.014331 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0780476_b199_47a1_97da_57501def2a82.slice/crio-b2ecadb1a4dde0a9aad7c9aab753bf3dad429b21393a68dd9fabd89643e9b161 WatchSource:0}: Error finding container b2ecadb1a4dde0a9aad7c9aab753bf3dad429b21393a68dd9fabd89643e9b161: Status 404 returned error can't find the container with id b2ecadb1a4dde0a9aad7c9aab753bf3dad429b21393a68dd9fabd89643e9b161 Jul 18 04:02:56.015677 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:56.015657 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 04:02:56.919145 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:56.919106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" event={"ID":"e0780476-b199-47a1-97da-57501def2a82","Type":"ContainerStarted","Data":"b2ecadb1a4dde0a9aad7c9aab753bf3dad429b21393a68dd9fabd89643e9b161"} Jul 18 04:02:57.926470 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:57.926432 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" event={"ID":"e0780476-b199-47a1-97da-57501def2a82","Type":"ContainerStarted","Data":"2013cda868cefc18c079399cdc1939bb2fabf0bbaab2918780cbfff7c1adc5ed"} Jul 18 04:02:57.941640 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:02:57.941591 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" podStartSLOduration=1.9410393479999999 podStartE2EDuration="2.941578154s" totalImagesPullingTime="1.000538806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:02:57.940372058 +0000 UTC m=+776.452739624" watchObservedRunningTime="2026-07-18 04:02:57.941578154 +0000 UTC m=+776.453945741" Jul 18 04:03:05.885138 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:05.885106 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:03:05.885611 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:05.885166 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:03:05.897600 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:05.897575 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:03:05.975004 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:05.974979 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qdbzx" Jul 18 04:03:10.165433 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.165403 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92"] Jul 18 04:03:10.168909 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.168891 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.171235 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.171216 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 18 04:03:10.177717 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.177694 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92"] Jul 18 04:03:10.193035 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.193010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d486f3-91b6-48be-9411-91032c2113f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.193176 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.193060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.193176 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.193079 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.193325 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.193191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.193325 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.193227 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.193325 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.193262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqh2l\" (UniqueName: \"kubernetes.io/projected/62d486f3-91b6-48be-9411-91032c2113f9-kube-api-access-lqh2l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294344 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294344 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294564 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294379 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqh2l\" (UniqueName: \"kubernetes.io/projected/62d486f3-91b6-48be-9411-91032c2113f9-kube-api-access-lqh2l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294564 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d486f3-91b6-48be-9411-91032c2113f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294564 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294564 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294511 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294825 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294793 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294888 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294851 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.294940 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.294896 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.296401 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.296378 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62d486f3-91b6-48be-9411-91032c2113f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.296774 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.296757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62d486f3-91b6-48be-9411-91032c2113f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.301350 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.301328 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqh2l\" (UniqueName: \"kubernetes.io/projected/62d486f3-91b6-48be-9411-91032c2113f9-kube-api-access-lqh2l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92\" (UID: \"62d486f3-91b6-48be-9411-91032c2113f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.480160 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.480071 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:10.608959 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.608931 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92"] Jul 18 04:03:10.611266 ip-10-0-133-144 kubenswrapper[2583]: W0718 04:03:10.611236 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d486f3_91b6_48be_9411_91032c2113f9.slice/crio-c153dc3a58e2a991da0be6bd7a97beac0d0fb1f718f5432c39201e09fb6d61f0 WatchSource:0}: Error finding container c153dc3a58e2a991da0be6bd7a97beac0d0fb1f718f5432c39201e09fb6d61f0: Status 404 returned error can't find the container with id c153dc3a58e2a991da0be6bd7a97beac0d0fb1f718f5432c39201e09fb6d61f0 Jul 18 04:03:10.986103 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.986073 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" event={"ID":"62d486f3-91b6-48be-9411-91032c2113f9","Type":"ContainerStarted","Data":"fe5747e4a528d2d122c04efce54f807eef66daae18877c1927310a502cdb844d"} Jul 18 04:03:10.986282 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:10.986123 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" event={"ID":"62d486f3-91b6-48be-9411-91032c2113f9","Type":"ContainerStarted","Data":"c153dc3a58e2a991da0be6bd7a97beac0d0fb1f718f5432c39201e09fb6d61f0"} Jul 18 04:03:11.001701 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:11.001658 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" podStartSLOduration=0.83655782 podStartE2EDuration="1.001643111s" totalImagesPullingTime="165.085291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:03:11.000211164 +0000 UTC m=+789.512578728" watchObservedRunningTime="2026-07-18 04:03:11.001643111 +0000 UTC m=+789.514010651" Jul 18 04:03:20.480472 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:20.480437 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:20.480856 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:20.480499 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:20.492386 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:20.492359 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:21.041218 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:21.041190 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92" Jul 18 04:03:23.068712 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.068673 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw"] Jul 18 04:03:23.072244 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.072222 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.074573 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.074551 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 18 04:03:23.081825 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.081795 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw"] Jul 18 04:03:23.198643 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.198613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.198770 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.198685 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.198770 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.198723 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.198770 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.198746 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e19c897-c28e-42db-8089-9def212e8cd3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.198880 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.198771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqpdd\" (UniqueName: \"kubernetes.io/projected/4e19c897-c28e-42db-8089-9def212e8cd3-kube-api-access-vqpdd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.198880 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.198814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.299889 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.299861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.299889 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.299894 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300096 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.299910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e19c897-c28e-42db-8089-9def212e8cd3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300096 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.299930 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqpdd\" (UniqueName: \"kubernetes.io/projected/4e19c897-c28e-42db-8089-9def212e8cd3-kube-api-access-vqpdd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300096 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.299989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300096 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.300042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300421 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.300394 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300505 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.300427 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.300505 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.300480 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.302145 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.302126 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e19c897-c28e-42db-8089-9def212e8cd3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.302272 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.302254 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e19c897-c28e-42db-8089-9def212e8cd3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.307004 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.306984 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqpdd\" (UniqueName: \"kubernetes.io/projected/4e19c897-c28e-42db-8089-9def212e8cd3-kube-api-access-vqpdd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fkfxw\" (UID: \"4e19c897-c28e-42db-8089-9def212e8cd3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.383681 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.383620 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:23.512803 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:23.512767 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw"] Jul 18 04:03:23.515501 ip-10-0-133-144 kubenswrapper[2583]: W0718 04:03:23.515472 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e19c897_c28e_42db_8089_9def212e8cd3.slice/crio-4e97fca9e95034d53d8e216eaf43052deeb961f1069a42bd554d5c0eb21dd53f WatchSource:0}: Error finding container 4e97fca9e95034d53d8e216eaf43052deeb961f1069a42bd554d5c0eb21dd53f: Status 404 returned error can't find the container with id 4e97fca9e95034d53d8e216eaf43052deeb961f1069a42bd554d5c0eb21dd53f Jul 18 04:03:24.042589 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:24.042508 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" event={"ID":"4e19c897-c28e-42db-8089-9def212e8cd3","Type":"ContainerStarted","Data":"616fea0306bd35d45e3ab740c89bb21e3241cf84bf6b867177e61416ef4272fa"} Jul 18 04:03:24.042589 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:24.042553 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" event={"ID":"4e19c897-c28e-42db-8089-9def212e8cd3","Type":"ContainerStarted","Data":"4e97fca9e95034d53d8e216eaf43052deeb961f1069a42bd554d5c0eb21dd53f"} Jul 18 04:03:24.059092 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:24.059044 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" podStartSLOduration=0.899693305 podStartE2EDuration="1.05902926s" totalImagesPullingTime="159.335955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 04:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:03:24.057279475 +0000 UTC m=+802.569647026" watchObservedRunningTime="2026-07-18 04:03:24.05902926 +0000 UTC m=+802.571396833" Jul 18 04:03:33.384525 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:33.384488 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:33.384935 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:33.384551 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:33.396936 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:33.396906 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:03:34.096495 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:03:34.096465 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fkfxw" Jul 18 04:05:22.566202 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:22.566170 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-86fl2_bc87efd8-cdd4-4c06-b707-56dcfeb7b963/server/0.log" Jul 18 04:05:23.032235 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:23.032206 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-kwctq_09e80bbb-b623-42bf-9ee9-aa90cb24493e/copy-manifests/0.log" Jul 18 04:05:23.044505 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:23.044482 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-kwctq_09e80bbb-b623-42bf-9ee9-aa90cb24493e/manager/0.log" Jul 18 04:05:25.955197 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:25.955171 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c59tn_4262e01e-c4c9-4327-8f16-8d8f4396f930/istio-proxy/0.log" Jul 18 04:05:26.068498 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:26.068469 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9pgsf_e6967bd8-91eb-4233-a97c-ed7f3f80e0da/discovery/0.log" Jul 18 04:05:26.393770 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:26.393687 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/1.log" Jul 18 04:05:26.719709 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:26.719679 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84477d5b-9njvc_2afbc857-ab37-47f3-acea-886d23b871d1/router/0.log" Jul 18 04:05:27.148056 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:27.147980 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qdbzx_e0780476-b199-47a1-97da-57501def2a82/main/0.log" Jul 18 04:05:27.361740 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:27.361707 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fpld92_62d486f3-91b6-48be-9411-91032c2113f9/main/0.log" Jul 18 04:05:27.473541 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:27.473514 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fkfxw_4e19c897-c28e-42db-8089-9def212e8cd3/main/0.log" Jul 18 04:05:35.339760 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:35.339730 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mkj45_85ed711a-4175-4ddd-97c9-bb033d8c2c66/global-pull-secret-syncer/0.log" Jul 18 04:05:35.444916 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:35.444890 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqp22_e2551dd2-e285-4d75-83c0-e7937ffbf046/konnectivity-agent/0.log" Jul 18 04:05:35.484646 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:35.484618 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-144.ec2.internal_64eb37ed0ac65b2b2fec0d5bd2802157/haproxy/0.log" Jul 18 04:05:42.553882 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.553850 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2xgb2_141e6639-8b03-4482-b178-268acd0ebe08/kube-state-metrics/0.log" Jul 18 04:05:42.571178 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.571155 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2xgb2_141e6639-8b03-4482-b178-268acd0ebe08/kube-rbac-proxy-main/0.log" Jul 18 04:05:42.593973 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.593953 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2xgb2_141e6639-8b03-4482-b178-268acd0ebe08/kube-rbac-proxy-self/0.log" Jul 18 04:05:42.615693 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.615673 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6ffb887499-4jxvc_a7a74570-50a9-4ab3-a108-f3a61c973747/metrics-server/0.log" Jul 18 04:05:42.820888 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.820816 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmsvh_b3f33ed1-cef9-4a25-8408-812804478b5d/node-exporter/0.log" Jul 18 04:05:42.848337 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.848311 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmsvh_b3f33ed1-cef9-4a25-8408-812804478b5d/kube-rbac-proxy/0.log" Jul 18 04:05:42.874122 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.874097 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmsvh_b3f33ed1-cef9-4a25-8408-812804478b5d/init-textfile/0.log" Jul 18 04:05:42.901416 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.901397 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-xx482_c406bb95-caa7-4d7f-85da-9400d7a2c0a6/kube-rbac-proxy-main/0.log" Jul 18 04:05:42.924220 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.924195 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-xx482_c406bb95-caa7-4d7f-85da-9400d7a2c0a6/kube-rbac-proxy-self/0.log" Jul 18 04:05:42.966616 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:42.966596 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-xx482_c406bb95-caa7-4d7f-85da-9400d7a2c0a6/openshift-state-metrics/0.log" Jul 18 04:05:43.175444 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:43.175416 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-4bb5t_68592025-9afb-4084-b7a8-a1748b7d9359/prometheus-operator/0.log" Jul 18 04:05:43.194141 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:43.194124 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-4bb5t_68592025-9afb-4084-b7a8-a1748b7d9359/kube-rbac-proxy/0.log" Jul 18 04:05:43.216480 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:43.216462 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-fhnmr_6d76ba69-b489-44c9-aaed-2a81a21c018e/prometheus-operator-admission-webhook/0.log" Jul 18 04:05:45.866171 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.866140 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv"] Jul 18 04:05:45.869844 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.869823 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:45.871875 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.871853 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2q2dr\"/\"openshift-service-ca.crt\"" Jul 18 04:05:45.872012 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.871993 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2q2dr\"/\"kube-root-ca.crt\"" Jul 18 04:05:45.872657 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.872643 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2q2dr\"/\"default-dockercfg-tcmmh\"" Jul 18 04:05:45.876312 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.876279 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv"] Jul 18 04:05:45.908294 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.908269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-sys\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:45.908434 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.908323 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbzsp\" (UniqueName: \"kubernetes.io/projected/8085ad43-9a06-40e8-acfc-9bf7104d64b5-kube-api-access-lbzsp\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:45.908434 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.908406 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-proc\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:45.908528 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.908461 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-lib-modules\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:45.908528 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:45.908479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-podres\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009529 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-lib-modules\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009529 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-podres\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009724 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009602 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-sys\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009724 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009646 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbzsp\" (UniqueName: \"kubernetes.io/projected/8085ad43-9a06-40e8-acfc-9bf7104d64b5-kube-api-access-lbzsp\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009724 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009658 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-podres\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009865 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009736 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-lib-modules\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009865 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009739 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-proc\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009865 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009752 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-sys\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.009865 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.009793 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8085ad43-9a06-40e8-acfc-9bf7104d64b5-proc\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.016644 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.016622 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbzsp\" (UniqueName: \"kubernetes.io/projected/8085ad43-9a06-40e8-acfc-9bf7104d64b5-kube-api-access-lbzsp\") pod \"perf-node-gather-daemonset-shwgv\" (UID: \"8085ad43-9a06-40e8-acfc-9bf7104d64b5\") " pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.180383 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.180356 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.311426 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.311400 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv"] Jul 18 04:05:46.313291 ip-10-0-133-144 kubenswrapper[2583]: W0718 04:05:46.313265 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8085ad43_9a06_40e8_acfc_9bf7104d64b5.slice/crio-50b3c10a90dba6dd5bca3feea67f87428b4244c990b5885b7d60340e24962cc9 WatchSource:0}: Error finding container 50b3c10a90dba6dd5bca3feea67f87428b4244c990b5885b7d60340e24962cc9: Status 404 returned error can't find the container with id 50b3c10a90dba6dd5bca3feea67f87428b4244c990b5885b7d60340e24962cc9 Jul 18 04:05:46.680508 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.680477 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" event={"ID":"8085ad43-9a06-40e8-acfc-9bf7104d64b5","Type":"ContainerStarted","Data":"29d181e0ca380729c41dfd2ca8628b9bdd2ab7408937104844298474a2295ced"} Jul 18 04:05:46.680683 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.680532 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" event={"ID":"8085ad43-9a06-40e8-acfc-9bf7104d64b5","Type":"ContainerStarted","Data":"50b3c10a90dba6dd5bca3feea67f87428b4244c990b5885b7d60340e24962cc9"} Jul 18 04:05:46.680683 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.680560 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:46.698544 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:46.698498 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" podStartSLOduration=1.698485062 podStartE2EDuration="1.698485062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 04:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 04:05:46.6967027 +0000 UTC m=+945.209070242" watchObservedRunningTime="2026-07-18 04:05:46.698485062 +0000 UTC m=+945.210852609" Jul 18 04:05:47.589849 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:47.589817 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7887m_49275967-d1a5-417e-a356-b4a6d853337b/dns/0.log" Jul 18 04:05:47.608001 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:47.607977 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7887m_49275967-d1a5-417e-a356-b4a6d853337b/kube-rbac-proxy/0.log" Jul 18 04:05:47.713144 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:47.713122 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kglbm_1eaa3070-fda9-4718-ba72-caf6ec05585f/dns-node-resolver/0.log" Jul 18 04:05:48.264562 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:48.264532 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jrzq9_c8d80b34-8bef-4571-9ff3-fc5058e52f7d/node-ca/0.log" Jul 18 04:05:49.195005 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:49.194978 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c59tn_4262e01e-c4c9-4327-8f16-8d8f4396f930/istio-proxy/0.log" Jul 18 04:05:49.237732 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:49.237672 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9pgsf_e6967bd8-91eb-4233-a97c-ed7f3f80e0da/discovery/0.log" Jul 18 04:05:49.310391 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:49.310354 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/0.log" Jul 18 04:05:49.310391 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:49.310356 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/1.log" Jul 18 04:05:49.387641 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:49.387621 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84477d5b-9njvc_2afbc857-ab37-47f3-acea-886d23b871d1/router/0.log" Jul 18 04:05:50.000928 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:50.000895 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gqx9d_b4bc9e1e-384b-4ea9-a4a7-891a4f971b50/serve-healthcheck-canary/0.log" Jul 18 04:05:50.468214 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:50.468186 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-q8fq6_a76197cf-e6c9-4336-875a-ff3050804f72/insights-operator/0.log" Jul 18 04:05:50.468757 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:50.468360 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-q8fq6_a76197cf-e6c9-4336-875a-ff3050804f72/insights-operator/1.log" Jul 18 04:05:50.616270 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:50.616240 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-phqkq_11917805-3879-4d13-927c-09386d5386da/kube-rbac-proxy/0.log" Jul 18 04:05:50.636920 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:50.636897 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-phqkq_11917805-3879-4d13-927c-09386d5386da/exporter/0.log" Jul 18 04:05:50.655686 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:50.655665 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-phqkq_11917805-3879-4d13-927c-09386d5386da/extractor/0.log" Jul 18 04:05:52.695139 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:52.695109 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2q2dr/perf-node-gather-daemonset-shwgv" Jul 18 04:05:52.768333 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:52.768287 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-86fl2_bc87efd8-cdd4-4c06-b707-56dcfeb7b963/server/0.log" Jul 18 04:05:52.967228 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:52.967152 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-kwctq_09e80bbb-b623-42bf-9ee9-aa90cb24493e/manager/0.log" Jul 18 04:05:52.982750 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:52.982727 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f994c8d8-kwctq_09e80bbb-b623-42bf-9ee9-aa90cb24493e/copy-manifests/0.log" Jul 18 04:05:54.098509 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:54.098481 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6df5b785c7-5g2zf_85134b6a-f2d7-4be2-8c7e-ab75491415b9/manager/0.log" Jul 18 04:05:56.289269 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:56.289228 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c59tn_4262e01e-c4c9-4327-8f16-8d8f4396f930/istio-proxy/0.log" Jul 18 04:05:56.324011 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:56.323981 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9pgsf_e6967bd8-91eb-4233-a97c-ed7f3f80e0da/discovery/0.log" Jul 18 04:05:56.369533 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:56.369510 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/1.log" Jul 18 04:05:56.369661 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:56.369627 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/0.log" Jul 18 04:05:56.410165 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:56.410140 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84477d5b-9njvc_2afbc857-ab37-47f3-acea-886d23b871d1/router/0.log" Jul 18 04:05:57.727082 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:57.727055 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4c59tn_4262e01e-c4c9-4327-8f16-8d8f4396f930/istio-proxy/0.log" Jul 18 04:05:57.762528 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:57.762505 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9pgsf_e6967bd8-91eb-4233-a97c-ed7f3f80e0da/discovery/0.log" Jul 18 04:05:57.804779 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:57.804749 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/0.log" Jul 18 04:05:57.805068 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:57.805053 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-jwpgn_22e5fa9b-9cbe-4522-b932-5ea249d4bfba/istio-proxy/1.log" Jul 18 04:05:57.851231 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:05:57.851212 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84477d5b-9njvc_2afbc857-ab37-47f3-acea-886d23b871d1/router/0.log" Jul 18 04:06:00.834381 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.834332 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/kube-multus-additional-cni-plugins/0.log" Jul 18 04:06:00.854375 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.854353 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/egress-router-binary-copy/0.log" Jul 18 04:06:00.873110 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.873083 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/cni-plugins/0.log" Jul 18 04:06:00.890795 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.890776 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/bond-cni-plugin/0.log" Jul 18 04:06:00.911269 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.911252 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/routeoverride-cni/0.log" Jul 18 04:06:00.929757 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.929736 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/whereabouts-cni-bincopy/0.log" Jul 18 04:06:00.949221 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:00.949195 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m4rhg_bbc8f9e0-4d62-4591-8e44-b75618f15c29/whereabouts-cni/0.log" Jul 18 04:06:01.116984 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:01.116910 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-crbwg_571383bd-4549-4e92-b7ad-124d82c0a842/kube-multus/0.log" Jul 18 04:06:01.277590 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:01.277563 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gdzq9_41787ee1-0ac0-4a06-a47e-9db479999abd/network-metrics-daemon/0.log" Jul 18 04:06:01.296397 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:01.296375 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gdzq9_41787ee1-0ac0-4a06-a47e-9db479999abd/kube-rbac-proxy/0.log" Jul 18 04:06:02.572327 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.572271 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/ovn-controller/0.log" Jul 18 04:06:02.589381 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.589361 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/ovn-acl-logging/0.log" Jul 18 04:06:02.612528 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.612505 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/kube-rbac-proxy-node/0.log" Jul 18 04:06:02.637609 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.637589 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/kube-rbac-proxy-ovn-metrics/0.log" Jul 18 04:06:02.657084 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.657051 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/northd/0.log" Jul 18 04:06:02.678516 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.678496 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/nbdb/0.log" Jul 18 04:06:02.699642 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.699625 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/sbdb/0.log" Jul 18 04:06:02.735580 ip-10-0-133-144 kubenswrapper[2583]: I0718 04:06:02.735558 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmqh8_14fcb42e-fe3b-4c93-b1c0-8959e427c3bf/ovnkube-controller/0.log"