Jul 11 03:41:01.612987 ip-10-0-142-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 11 03:41:01.612999 ip-10-0-142-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 11 03:41:01.613006 ip-10-0-142-101 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 11 03:41:01.613239 ip-10-0-142-101 systemd[1]: Failed to start Kubernetes Kubelet. Jul 11 03:41:11.798873 ip-10-0-142-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 11 03:41:11.798892 ip-10-0-142-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 54846e690e2547a8ab88888432a07f9e -- Jul 11 03:42:48.128305 ip-10-0-142-101 systemd[1]: Starting Kubernetes Kubelet... Jul 11 03:42:48.580722 ip-10-0-142-101 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 03:42:48.580722 ip-10-0-142-101 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 11 03:42:48.580722 ip-10-0-142-101 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 03:42:48.580722 ip-10-0-142-101 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 11 03:42:48.580722 ip-10-0-142-101 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 03:42:48.582776 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.582681 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 11 03:42:48.590760 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590732 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:42:48.590760 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590754 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:42:48.590760 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590759 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:42:48.590760 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590763 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:42:48.590760 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590767 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:42:48.590760 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590771 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590775 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590780 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590785 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590789 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590793 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590797 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590801 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590804 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590808 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590812 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590816 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590820 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590823 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590829 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590835 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590839 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590845 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590849 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590853 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:42:48.591121 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590857 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590861 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590870 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590875 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590879 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590883 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590887 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590890 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590895 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590898 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590902 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590907 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590910 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590916 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590921 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590925 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590929 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590934 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590939 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590943 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590948 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:42:48.591928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590952 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590957 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590961 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590965 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590969 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590974 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590978 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590982 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590988 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.590995 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591000 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591005 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591009 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591014 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591038 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591043 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591047 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591051 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:42:48.592806 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591058 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591064 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591069 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591073 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591078 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591083 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591087 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591093 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591099 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591103 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591107 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591111 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591116 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591119 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591123 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591127 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591132 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591136 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591139 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591145 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:42:48.593554 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591149 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591153 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591157 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591162 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591166 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591170 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591174 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591178 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591213 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591220 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591224 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591229 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591234 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591238 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.591243 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592430 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592440 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592445 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592451 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:42:48.594467 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592456 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592460 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592465 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592470 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592474 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592478 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592482 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592487 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592491 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592496 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592500 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592504 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592508 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592513 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592518 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592522 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592526 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592530 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592535 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:42:48.595276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592539 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592543 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592547 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592551 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592555 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592559 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592563 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592568 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592572 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592576 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592580 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592584 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592591 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592598 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592602 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592608 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592612 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592617 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592622 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592626 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:42:48.595908 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592631 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592636 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592640 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592646 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592653 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592657 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592662 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592669 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592674 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592678 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592682 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592687 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592692 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592697 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592701 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592705 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592710 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592715 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592719 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592723 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:42:48.596449 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592727 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592732 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592736 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592741 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592745 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592750 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592755 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592759 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592763 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592767 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592775 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592781 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592786 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592791 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592796 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592800 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592804 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592809 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592812 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592816 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:42:48.596996 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592822 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592827 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592831 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592835 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592839 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592844 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592848 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592852 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592857 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592861 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592866 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592870 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592874 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592878 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592882 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.592887 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593541 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593551 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593556 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593560 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:42:48.597667 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593564 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593568 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593572 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593576 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593581 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593585 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593589 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593594 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593598 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593603 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593607 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593611 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593616 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593623 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593629 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593634 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593639 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593643 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593647 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:42:48.598281 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593652 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593656 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593661 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593665 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593669 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593673 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593678 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593681 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593687 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593690 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593697 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593702 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593706 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593711 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593716 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593721 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593726 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593730 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593735 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593739 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:42:48.598734 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593743 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593748 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593752 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593757 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593761 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593765 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593771 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593776 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593782 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593787 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593792 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593796 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593800 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593804 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593808 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593812 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593816 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593821 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593824 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593831 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:42:48.599332 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593835 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593839 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593845 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593850 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593854 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593858 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593862 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593867 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593871 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593875 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593879 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593882 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593887 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593891 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593896 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593902 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593907 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593912 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593918 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:42:48.599928 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593923 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593927 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593931 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593936 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593940 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593945 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593949 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593953 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593957 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593960 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593965 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593969 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593973 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593978 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593982 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593989 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.593993 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594121 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594133 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594143 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 11 03:42:48.600448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594149 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594156 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594162 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594169 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594175 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594180 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594185 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594191 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594197 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594202 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594207 2572 flags.go:64] FLAG: --cgroup-root="" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594212 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594217 2572 flags.go:64] FLAG: --client-ca-file="" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594222 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594227 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594234 2572 flags.go:64] FLAG: --cluster-domain="" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594239 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594244 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594249 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594254 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594260 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594265 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594270 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 11 03:42:48.600930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594275 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594280 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594285 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594289 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594296 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594301 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594307 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594312 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594317 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594322 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594326 2572 flags.go:64] FLAG: --enable-server="true" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594331 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594338 2572 flags.go:64] FLAG: --event-burst="100" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594343 2572 flags.go:64] FLAG: --event-qps="50" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594347 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594352 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594357 2572 flags.go:64] FLAG: --eviction-hard="" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594363 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594368 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594373 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594378 2572 flags.go:64] FLAG: --eviction-soft="" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594383 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594388 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594394 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594399 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 11 03:42:48.601502 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594404 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594408 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594413 2572 flags.go:64] FLAG: --feature-gates="" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594419 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594424 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594429 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594434 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594439 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594444 2572 flags.go:64] FLAG: --help="false" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594448 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594453 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594459 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594464 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594469 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594474 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594478 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594483 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594487 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594491 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594497 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594502 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594507 2572 flags.go:64] FLAG: --kube-reserved="" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594511 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594516 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 11 03:42:48.602142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594523 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594527 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594532 2572 flags.go:64] FLAG: --lock-file="" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594536 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594540 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594546 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594555 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594561 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594565 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594570 2572 flags.go:64] FLAG: --logging-format="text" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594574 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594580 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594584 2572 flags.go:64] FLAG: --manifest-url="" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594589 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594596 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594601 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594607 2572 flags.go:64] FLAG: --max-pods="110" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594612 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594616 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594623 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594627 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594632 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594637 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594641 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594653 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 11 03:42:48.602790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594657 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594662 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594667 2572 flags.go:64] FLAG: --pod-cidr="" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594671 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594679 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594683 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594688 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594694 2572 flags.go:64] FLAG: --port="10250" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594699 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594704 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-079e0d6b19b4a5e22" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594709 2572 flags.go:64] FLAG: --qos-reserved="" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594714 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594719 2572 flags.go:64] FLAG: --register-node="true" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594723 2572 flags.go:64] FLAG: --register-with-taints="" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594729 2572 flags.go:64] FLAG: --registry-burst="10" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594734 2572 flags.go:64] FLAG: --registry-qps="5" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594739 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594744 2572 flags.go:64] FLAG: --reserved-memory="" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594750 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594755 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594760 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594765 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594769 2572 flags.go:64] FLAG: --runonce="false" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594773 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594778 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 11 03:42:48.603446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594783 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594788 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594795 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594799 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594804 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594810 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594814 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594819 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594823 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594828 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594832 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594837 2572 flags.go:64] FLAG: --system-cgroups="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594841 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594850 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594856 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594861 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594867 2572 flags.go:64] FLAG: --tls-min-version="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594872 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594876 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594881 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594886 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594890 2572 flags.go:64] FLAG: --v="2" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594896 2572 flags.go:64] FLAG: --version="false" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594904 2572 flags.go:64] FLAG: --vmodule="" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594909 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 11 03:42:48.604180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.594915 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595144 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595153 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595158 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595163 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595168 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595172 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595177 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595181 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595187 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595192 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595196 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595201 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595205 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595209 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595214 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595218 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595222 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595226 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595230 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:42:48.604786 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595234 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595243 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595248 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595253 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595257 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595261 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595265 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595269 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595274 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595287 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595291 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595296 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595300 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595307 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595312 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595317 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595322 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595326 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595330 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:42:48.605275 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595334 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595339 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595346 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595350 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595354 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595358 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595363 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595367 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595371 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595376 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595380 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595384 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595388 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595392 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595398 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595402 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595407 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595411 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595415 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595419 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:42:48.605730 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595423 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595430 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595435 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595440 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595444 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595451 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595455 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595460 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595465 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595469 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595473 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595477 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595481 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595486 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595491 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595495 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595500 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595503 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595508 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:42:48.606234 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595512 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595516 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595520 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595524 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595528 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595533 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595537 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595543 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595547 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595552 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595555 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595560 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595564 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595568 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595573 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595577 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595581 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595585 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595589 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595596 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:42:48.606688 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595600 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.595603 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.596436 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.605051 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.605070 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.606001 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.606008 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606077 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606083 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606087 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606092 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606096 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606099 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606102 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:42:48.607185 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606105 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606107 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606110 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606112 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606115 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606118 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606120 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606123 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606126 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606129 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606131 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606134 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606136 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606139 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606141 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606144 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606146 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606148 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606151 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:42:48.607556 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606153 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606156 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606158 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606162 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606165 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606168 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606171 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606173 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606175 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606178 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606180 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606183 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606186 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606188 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606191 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606193 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606196 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606198 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606201 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606203 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:42:48.608007 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606206 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606208 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606211 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606213 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606217 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606220 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606223 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606225 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606228 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606230 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606234 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606237 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606240 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606243 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606246 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606250 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606254 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606256 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606259 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:42:48.608585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606261 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606264 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606266 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606269 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606271 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606274 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606276 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606279 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606281 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606284 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606286 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606288 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606291 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606293 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606296 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606299 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606301 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606304 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606306 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606309 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:42:48.609068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606311 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606314 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606316 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606318 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606321 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606323 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606326 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606328 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606331 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606334 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606337 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606339 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606341 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606344 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.606349 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 03:42:48.609543 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606479 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606483 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606486 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606489 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606492 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606495 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606498 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606500 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606503 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606505 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606508 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606510 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606513 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606516 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606519 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606521 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606524 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606527 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606530 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 03:42:48.609906 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606533 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606535 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606537 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606540 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606543 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606546 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606549 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606552 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606554 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606557 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606561 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606564 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606567 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606570 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606573 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606575 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606578 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606580 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606583 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606585 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 03:42:48.610380 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606588 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606590 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606592 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606595 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606597 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606599 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606602 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606604 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606607 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606609 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606611 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606614 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606616 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606619 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606621 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606624 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606626 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606628 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606631 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606634 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 03:42:48.610854 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606636 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606639 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606642 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606644 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606647 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606649 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606652 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606654 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606656 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606659 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606661 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606664 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606666 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606668 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606671 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606674 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606676 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606678 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606681 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606683 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 03:42:48.611356 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606685 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606688 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606691 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606693 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606697 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606700 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606703 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606706 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606709 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606711 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606714 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606717 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606719 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606722 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606724 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606730 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606732 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606735 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606737 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 03:42:48.611823 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:48.606740 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 03:42:48.612345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.606745 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 03:42:48.612345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.606868 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 11 03:42:48.612345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.609201 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 11 03:42:48.612345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.610765 2572 server.go:1019] "Starting client certificate rotation" Jul 11 03:42:48.612345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.610868 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 03:42:48.612345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.611738 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 03:42:48.614511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.614496 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 03:42:48.617252 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.617228 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 03:42:48.628731 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.628708 2572 log.go:25] "Validated CRI v1 runtime API" Jul 11 03:42:48.631231 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.631216 2572 log.go:25] "Validated CRI v1 image API" Jul 11 03:42:48.632823 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.632807 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 11 03:42:48.636409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.636391 2572 fs.go:135] Filesystem UUIDs: map[63b9c183-3e15-458b-93e8-c9ec973d2ef8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8308ab41-8d8c-4cae-91d9-edc89387e870:/dev/nvme0n1p3] Jul 11 03:42:48.636458 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.636410 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 11 03:42:48.641164 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.641148 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 03:42:48.642832 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.642723 2572 manager.go:216] Machine: {Timestamp:2026-07-11 03:42:48.641005804 +0000 UTC m=+0.375162470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f6e02880145884224b2617184d51 SystemUUID:ec28f6e0-2880-1458-8422-4b2617184d51 BootID:54846e69-0e25-47a8-ab88-888432a07f9e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:c7:bc:9b:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:c7:bc:9b:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:2c:12:66:38:f4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 11 03:42:48.642832 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.642828 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 11 03:42:48.642936 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.642907 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 11 03:42:48.646353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.646325 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 11 03:42:48.646492 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.646356 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 11 03:42:48.647166 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.647156 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 11 03:42:48.647208 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.647168 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 11 03:42:48.647208 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.647176 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 03:42:48.647999 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.647989 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 03:42:48.649301 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.649291 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 11 03:42:48.653188 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653177 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 11 03:42:48.653309 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653299 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 11 03:42:48.653338 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653330 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 11 03:42:48.653368 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653339 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 11 03:42:48.653368 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653357 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 11 03:42:48.653368 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653366 2572 kubelet.go:398] "Adding apiserver pod source" Jul 11 03:42:48.653461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653374 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 11 03:42:48.653766 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653754 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 03:42:48.653808 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.653781 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 03:42:48.656287 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.656257 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 11 03:42:48.657725 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.657706 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9c4fc" Jul 11 03:42:48.658452 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.658432 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 11 03:42:48.658528 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.658475 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 11 03:42:48.659393 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659372 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659398 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659409 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659420 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659434 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659443 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659457 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 11 03:42:48.659481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659475 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 11 03:42:48.659791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659486 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 11 03:42:48.659791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659497 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 11 03:42:48.659791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659511 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 11 03:42:48.659791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.659521 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 11 03:42:48.660603 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.660561 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 11 03:42:48.660734 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.660719 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 11 03:42:48.663606 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.663573 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 11 03:42:48.663702 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.663622 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 11 03:42:48.663702 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.663626 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 11 03:42:48.664642 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.664624 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9c4fc" Jul 11 03:42:48.664753 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.664739 2572 server.go:1268] "Started kubelet" Jul 11 03:42:48.664833 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.664797 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 11 03:42:48.665049 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.664860 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 11 03:42:48.665049 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.664923 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 11 03:42:48.665731 ip-10-0-142-101 systemd[1]: Started Kubernetes Kubelet. Jul 11 03:42:48.665832 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.665792 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 11 03:42:48.667399 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.667383 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 11 03:42:48.670364 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.670347 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 11 03:42:48.672126 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.672109 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 11 03:42:48.672126 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.672121 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 11 03:42:48.672268 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.672248 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:48.672822 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.672808 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 11 03:42:48.672822 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.672815 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 11 03:42:48.672962 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.672835 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 11 03:42:48.672962 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.672913 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 11 03:42:48.673079 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673015 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 11 03:42:48.673151 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673135 2572 factory.go:55] Registering systemd factory Jul 11 03:42:48.673189 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673175 2572 factory.go:223] Registration of the systemd container factory successfully Jul 11 03:42:48.673394 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673379 2572 factory.go:153] Registering CRI-O factory Jul 11 03:42:48.673394 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673395 2572 factory.go:223] Registration of the crio container factory successfully Jul 11 03:42:48.673507 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673446 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 11 03:42:48.673507 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673472 2572 factory.go:103] Registering Raw factory Jul 11 03:42:48.673507 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.673487 2572 manager.go:1196] Started watching for new ooms in manager Jul 11 03:42:48.674142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.674123 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:42:48.674448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.674431 2572 manager.go:349] Starting recovery of all containers Jul 11 03:42:48.677326 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.677295 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-101.ec2.internal\" not found" node="ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.685097 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.684950 2572 manager.go:354] Recovery completed Jul 11 03:42:48.690305 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.690287 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.692361 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692347 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.692486 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692378 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.692486 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692392 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.692986 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692966 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 11 03:42:48.692986 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692977 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.692986 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692980 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 11 03:42:48.693140 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.692997 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 11 03:42:48.693721 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.693694 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.693798 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.693730 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.693798 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.693744 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.694133 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.694120 2572 policy_none.go:49] "None policy: Start" Jul 11 03:42:48.694183 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.694136 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 11 03:42:48.694183 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.694146 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 11 03:42:48.694902 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.694892 2572 policy_none.go:47] "Start" Jul 11 03:42:48.736696 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.736679 2572 manager.go:337] "Starting Device Plugin manager" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.736720 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.736733 2572 server.go:87] "Starting device plugin registration server" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.736992 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.737006 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.737132 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.737193 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.737201 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.737710 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 11 03:42:48.746762 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.737756 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:48.810954 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.810913 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 11 03:42:48.812325 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.812296 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 11 03:42:48.812435 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.812341 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 11 03:42:48.812435 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.812370 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 11 03:42:48.812435 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.812410 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 11 03:42:48.814656 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.814633 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:42:48.837732 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.837652 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.838778 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.838760 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.838883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.838791 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.838883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.838800 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.838883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.838824 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.849975 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.849950 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.850106 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.849980 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-101.ec2.internal\": node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:48.862963 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.862939 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:48.913364 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.913338 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal"] Jul 11 03:42:48.913461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.913415 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.914946 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.914931 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.915059 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.914966 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.915059 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.914980 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.916110 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916095 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.916236 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.916280 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916251 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.916839 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916825 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.916911 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916850 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.916911 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916864 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.916911 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916876 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.916911 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916893 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.916911 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.916904 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.917887 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.917871 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.917959 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.917901 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 03:42:48.918578 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.918564 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientMemory" Jul 11 03:42:48.918646 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.918590 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 03:42:48.918646 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.918601 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeHasSufficientPID" Jul 11 03:42:48.932567 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.932548 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-101.ec2.internal\" not found" node="ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.935820 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.935806 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-101.ec2.internal\" not found" node="ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.963442 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:48.963425 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:48.975006 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.974985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/077fca01a64486b516cac217b95ed2fa-config\") pod \"kube-apiserver-proxy-ip-10-0-142-101.ec2.internal\" (UID: \"077fca01a64486b516cac217b95ed2fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.975085 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.975009 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0ff4a720fce2411438eb201c85e2744-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal\" (UID: \"f0ff4a720fce2411438eb201c85e2744\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:48.975085 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:48.975046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0ff4a720fce2411438eb201c85e2744-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal\" (UID: \"f0ff4a720fce2411438eb201c85e2744\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.063711 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.063673 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.076115 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.076091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/077fca01a64486b516cac217b95ed2fa-config\") pod \"kube-apiserver-proxy-ip-10-0-142-101.ec2.internal\" (UID: \"077fca01a64486b516cac217b95ed2fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.076179 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.076123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0ff4a720fce2411438eb201c85e2744-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal\" (UID: \"f0ff4a720fce2411438eb201c85e2744\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.076179 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.076141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0ff4a720fce2411438eb201c85e2744-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal\" (UID: \"f0ff4a720fce2411438eb201c85e2744\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.076179 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.076174 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f0ff4a720fce2411438eb201c85e2744-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal\" (UID: \"f0ff4a720fce2411438eb201c85e2744\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.076273 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.076185 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/077fca01a64486b516cac217b95ed2fa-config\") pod \"kube-apiserver-proxy-ip-10-0-142-101.ec2.internal\" (UID: \"077fca01a64486b516cac217b95ed2fa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.076273 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.076210 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0ff4a720fce2411438eb201c85e2744-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal\" (UID: \"f0ff4a720fce2411438eb201c85e2744\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.164619 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.164557 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.235140 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.235104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.238801 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.238621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" Jul 11 03:42:49.265174 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.265145 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.365699 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.365661 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.466285 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.466210 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.566876 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.566835 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.610325 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.610291 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 11 03:42:49.610935 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.610437 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 03:42:49.610935 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.610466 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 03:42:49.667496 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.667473 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.669208 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.669181 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 03:37:49 +0000 UTC" deadline="2027-12-24 03:22:37.03008926 +0000 UTC" Jul 11 03:42:49.669208 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.669207 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12743h39m47.360885833s" Jul 11 03:42:49.751341 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:49.751311 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077fca01a64486b516cac217b95ed2fa.slice/crio-02552de8865e491824e45528bef47c6cb667745d4b579b77031d494465c909a9 WatchSource:0}: Error finding container 02552de8865e491824e45528bef47c6cb667745d4b579b77031d494465c909a9: Status 404 returned error can't find the container with id 02552de8865e491824e45528bef47c6cb667745d4b579b77031d494465c909a9 Jul 11 03:42:49.751608 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:49.751589 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ff4a720fce2411438eb201c85e2744.slice/crio-f7158c6222bd9540e6ca8bd8205419524ac52b006dd6dccd51613919b5a80c93 WatchSource:0}: Error finding container f7158c6222bd9540e6ca8bd8205419524ac52b006dd6dccd51613919b5a80c93: Status 404 returned error can't find the container with id f7158c6222bd9540e6ca8bd8205419524ac52b006dd6dccd51613919b5a80c93 Jul 11 03:42:49.756236 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.756217 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 03:42:49.768413 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.768395 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.811612 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.811583 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:42:49.816364 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.816312 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" event={"ID":"077fca01a64486b516cac217b95ed2fa","Type":"ContainerStarted","Data":"02552de8865e491824e45528bef47c6cb667745d4b579b77031d494465c909a9"} Jul 11 03:42:49.817795 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:49.817756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" event={"ID":"f0ff4a720fce2411438eb201c85e2744","Type":"ContainerStarted","Data":"f7158c6222bd9540e6ca8bd8205419524ac52b006dd6dccd51613919b5a80c93"} Jul 11 03:42:49.868560 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.868526 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:49.969065 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:49.969016 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-101.ec2.internal\" not found" Jul 11 03:42:50.001739 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:50.001665 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:42:51.089087 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.089066 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" Jul 11 03:42:51.098699 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.098682 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 03:42:51.099609 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.099597 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" Jul 11 03:42:51.106670 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.106644 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 03:42:51.671435 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.671386 2572 apiserver.go:52] "Watching apiserver" Jul 11 03:42:51.681239 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.681211 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 11 03:42:51.681830 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.681806 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-x5nb4","kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal","openshift-dns/node-resolver-pdfk6","openshift-image-registry/node-ca-m2h5c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal","openshift-network-diagnostics/network-check-target-h2wlt","openshift-network-operator/iptables-alerter-g9lsc","openshift-ovn-kubernetes/ovnkube-node-zvh7l","kube-system/global-pull-secret-syncer-jfgct","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42","openshift-cluster-node-tuning-operator/tuned-7nfl7","openshift-multus/multus-additional-cni-plugins-fv9kd","openshift-multus/multus-mrgdx","openshift-multus/network-metrics-daemon-tq6x7"] Jul 11 03:42:51.683295 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.683277 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.684332 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.684310 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.685306 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.685282 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.685405 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.685385 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t58cd\"" Jul 11 03:42:51.685807 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.685785 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.685921 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.685870 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 11 03:42:51.685983 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.685785 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.686430 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.686411 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.687082 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.686929 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.687082 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.687028 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.687082 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.687128 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nck22\"" Jul 11 03:42:51.688201 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.688181 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.688425 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.688402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sz6cw\"" Jul 11 03:42:51.688509 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.688442 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.688835 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.688816 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.688936 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.688874 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6h7j\"" Jul 11 03:42:51.689273 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.689063 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 11 03:42:51.689273 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.689076 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.691217 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.691198 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 11 03:42:51.694075 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.693922 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:51.694075 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.693992 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:42:51.695186 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.694811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:51.695186 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.694944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:42:51.695928 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.695909 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.696012 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.695971 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:42:51.697178 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.697135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.698443 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.698425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.699541 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.699523 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.699742 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.699723 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.699823 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.699778 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 11 03:42:51.700327 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.700068 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.701054 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8sk7d\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.701451 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.701549 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.701743 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.701778 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.701997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.702199 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.702297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vlc9j\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.702555 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-trblz\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.702810 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 11 03:42:51.703060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.702994 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703110 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703218 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cc1f308-409c-4eb8-8280-acf8adacb765-host-slash\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4vc8\" (UniqueName: \"kubernetes.io/projected/4cc1f308-409c-4eb8-8280-acf8adacb765-kube-api-access-v4vc8\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysconfig\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysctl-d\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-run\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-host\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9cs\" (UniqueName: \"kubernetes.io/projected/e9800e7e-9028-4168-9e95-f980f495673b-kube-api-access-9r9cs\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-626k6\" (UniqueName: \"kubernetes.io/projected/22cd8457-4984-435a-b375-7befca8e0ea4-kube-api-access-626k6\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-kubernetes\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-var-lib-kubelet\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.703639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-tuned\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-tmp\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9800e7e-9028-4168-9e95-f980f495673b-hosts-file\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzlv8\" (UniqueName: \"kubernetes.io/projected/cd4b3579-8747-4027-ab5e-604679a76ef8-kube-api-access-hzlv8\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysctl-conf\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-systemd\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.703933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsl6x\" (UniqueName: \"kubernetes.io/projected/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-kube-api-access-rsl6x\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9800e7e-9028-4168-9e95-f980f495673b-tmp-dir\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22cd8457-4984-435a-b375-7befca8e0ea4-host\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22cd8457-4984-435a-b375-7befca8e0ea4-serviceca\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cc1f308-409c-4eb8-8280-acf8adacb765-iptables-alerter-script\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-modprobe-d\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-sys\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-lib-modules\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.704868 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:51.705156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.704941 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.707511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.706606 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 03:42:51.707511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.706661 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.707511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.707225 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 11 03:42:51.707511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.707237 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qxlvb\"" Jul 11 03:42:51.707511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.707258 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 11 03:42:51.708592 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.708575 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 11 03:42:51.708714 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.708699 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 11 03:42:51.708826 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.708817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdmtl\"" Jul 11 03:42:51.723514 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.723471 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lwnnr" Jul 11 03:42:51.733429 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.733401 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lwnnr" Jul 11 03:42:51.790698 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.790673 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 11 03:42:51.804590 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsl6x\" (UniqueName: \"kubernetes.io/projected/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-kube-api-access-rsl6x\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.804726 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.804726 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-run-ovn-kubernetes\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.804726 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/181d637f-b639-4b48-ab70-bb7ab1d2f539-agent-certs\") pod \"konnectivity-agent-x5nb4\" (UID: \"181d637f-b639-4b48-ab70-bb7ab1d2f539\") " pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4vc8\" (UniqueName: \"kubernetes.io/projected/4cc1f308-409c-4eb8-8280-acf8adacb765-kube-api-access-v4vc8\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804789 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-tmp\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-cni-binary-copy\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovnkube-config\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.804884 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:51.804934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85gr\" (UniqueName: \"kubernetes.io/projected/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-kube-api-access-v85gr\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.804931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-daemon-config\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.804981 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:42:52.304945733 +0000 UTC m=+3.022283963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805192 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-run-netns\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovnkube-script-lib\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.805267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9800e7e-9028-4168-9e95-f980f495673b-hosts-file\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzlv8\" (UniqueName: \"kubernetes.io/projected/cd4b3579-8747-4027-ab5e-604679a76ef8-kube-api-access-hzlv8\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysctl-conf\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e9800e7e-9028-4168-9e95-f980f495673b-hosts-file\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-multus-certs\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-lib-modules\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-socket-dir-parent\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805519 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-cni-bin\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.805566 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805535 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/181d637f-b639-4b48-ab70-bb7ab1d2f539-konnectivity-ca\") pod \"konnectivity-agent-x5nb4\" (UID: \"181d637f-b639-4b48-ab70-bb7ab1d2f539\") " pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.805904 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805576 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-lib-modules\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.805904 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805583 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysctl-conf\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.805904 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.805573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.806131 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cc1f308-409c-4eb8-8280-acf8adacb765-host-slash\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.806201 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysconfig\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.806201 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806185 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4cc1f308-409c-4eb8-8280-acf8adacb765-host-slash\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.806296 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.806296 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806265 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysconfig\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.806420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806304 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-system-cni-dir\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.806420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/006221a2-c572-4015-97af-6820d0ac7a4d-dbus\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.806420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-systemd\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.806420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-node-log\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.806616 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-registration-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.806616 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2ch\" (UniqueName: \"kubernetes.io/projected/dffbef86-9c16-4aee-b2cf-f2541f11d646-kube-api-access-ls2ch\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.806616 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806470 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thkkg\" (UniqueName: \"kubernetes.io/projected/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-kube-api-access-thkkg\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.806616 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-cni-binary-copy\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.806805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovn-node-metrics-cert\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.806805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9800e7e-9028-4168-9e95-f980f495673b-tmp-dir\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.806805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cc1f308-409c-4eb8-8280-acf8adacb765-iptables-alerter-script\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.806805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-modprobe-d\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.806805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-system-cni-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-os-release\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-kubelet\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-env-overrides\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysctl-d\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-device-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806945 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-modprobe-d\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-sys-fs\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.807052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.806982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-cnibin\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807066 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9800e7e-9028-4168-9e95-f980f495673b-tmp-dir\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-sysctl-d\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9cs\" (UniqueName: \"kubernetes.io/projected/e9800e7e-9028-4168-9e95-f980f495673b-kube-api-access-9r9cs\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807136 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-626k6\" (UniqueName: \"kubernetes.io/projected/22cd8457-4984-435a-b375-7befca8e0ea4-kube-api-access-626k6\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-kubernetes\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-var-lib-kubelet\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-etc-kubernetes\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-var-lib-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807308 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4cc1f308-409c-4eb8-8280-acf8adacb765-iptables-alerter-script\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-socket-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-hostroot\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807382 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-var-lib-kubelet\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-kubernetes\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.807461 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-conf-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-log-socket\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-cni-netd\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-k8s-cni-cncf-io\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-netns\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807641 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-cni-multus\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-run\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-tuned\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807784 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-kubelet\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807806 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-ovn\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807824 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-run\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-cni-bin\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-cni-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-cnibin\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-os-release\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.808228 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.807978 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/006221a2-c572-4015-97af-6820d0ac7a4d-kubelet-config\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-systemd-units\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-slash\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-systemd\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-etc-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-422l2\" (UniqueName: \"kubernetes.io/projected/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-kube-api-access-422l2\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808156 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22cd8457-4984-435a-b375-7befca8e0ea4-host\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808160 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-systemd\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22cd8457-4984-435a-b375-7befca8e0ea4-serviceca\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-sys\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808230 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22cd8457-4984-435a-b375-7befca8e0ea4-host\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-host\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-sys\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808310 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-host\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.808938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.808600 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22cd8457-4984-435a-b375-7befca8e0ea4-serviceca\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.809467 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.809259 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-tmp\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.810778 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.810755 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-etc-tuned\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.811816 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.811794 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsl6x\" (UniqueName: \"kubernetes.io/projected/4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e-kube-api-access-rsl6x\") pod \"tuned-7nfl7\" (UID: \"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e\") " pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:51.814517 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.814499 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4vc8\" (UniqueName: \"kubernetes.io/projected/4cc1f308-409c-4eb8-8280-acf8adacb765-kube-api-access-v4vc8\") pod \"iptables-alerter-g9lsc\" (UID: \"4cc1f308-409c-4eb8-8280-acf8adacb765\") " pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:51.818444 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.818424 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzlv8\" (UniqueName: \"kubernetes.io/projected/cd4b3579-8747-4027-ab5e-604679a76ef8-kube-api-access-hzlv8\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:51.819130 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.819112 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-626k6\" (UniqueName: \"kubernetes.io/projected/22cd8457-4984-435a-b375-7befca8e0ea4-kube-api-access-626k6\") pod \"node-ca-m2h5c\" (UID: \"22cd8457-4984-435a-b375-7befca8e0ea4\") " pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:51.819511 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.819489 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9cs\" (UniqueName: \"kubernetes.io/projected/e9800e7e-9028-4168-9e95-f980f495673b-kube-api-access-9r9cs\") pod \"node-resolver-pdfk6\" (UID: \"e9800e7e-9028-4168-9e95-f980f495673b\") " pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:51.909047 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-node-log\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-registration-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2ch\" (UniqueName: \"kubernetes.io/projected/dffbef86-9c16-4aee-b2cf-f2541f11d646-kube-api-access-ls2ch\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thkkg\" (UniqueName: \"kubernetes.io/projected/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-kube-api-access-thkkg\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909128 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-node-log\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-cni-binary-copy\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909156 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-registration-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovn-node-metrics-cert\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-system-cni-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-os-release\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-kubelet\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-env-overrides\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-device-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909374 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-sys-fs\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-cnibin\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-system-cni-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-etc-kubernetes\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909468 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-kubelet\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909469 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-sys-fs\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909512 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-device-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909402 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-os-release\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909528 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-var-lib-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909530 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-cnibin\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909566 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-etc-kubernetes\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.909594 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909588 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-var-lib-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909644 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-cni-binary-copy\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909631 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909663 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-socket-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-hostroot\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-conf-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-log-socket\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909762 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-socket-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-cni-netd\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909801 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-cni-netd\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-k8s-cni-cncf-io\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-netns\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909866 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-hostroot\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-cni-multus\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909885 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-conf-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-k8s-cni-cncf-io\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909914 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-netns\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910191 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909939 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-cni-multus\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-log-socket\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-kubelet\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.909978 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-ovn\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910014 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-kubelet\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-cni-bin\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910049 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-ovn\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910056 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-cni-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910083 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-env-overrides\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-cnibin\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910104 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-cni-dir\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910090 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-cni-bin\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910118 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-cnibin\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-os-release\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.910730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910153 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910161 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-os-release\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/006221a2-c572-4015-97af-6820d0ac7a4d-kubelet-config\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910208 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-systemd-units\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-slash\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-etc-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910285 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/006221a2-c572-4015-97af-6820d0ac7a4d-kubelet-config\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910270 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-slash\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-etc-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-422l2\" (UniqueName: \"kubernetes.io/projected/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-kube-api-access-422l2\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910331 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-systemd-units\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910346 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-run-ovn-kubernetes\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/181d637f-b639-4b48-ab70-bb7ab1d2f539-agent-certs\") pod \"konnectivity-agent-x5nb4\" (UID: \"181d637f-b639-4b48-ab70-bb7ab1d2f539\") " pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910413 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-openvswitch\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-cni-binary-copy\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovnkube-config\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.911353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910455 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-run-ovn-kubernetes\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85gr\" (UniqueName: \"kubernetes.io/projected/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-kube-api-access-v85gr\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-daemon-config\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-run-netns\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910600 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-host-run-netns\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.910675 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910686 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.910740 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:42:52.410719824 +0000 UTC m=+3.128058052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.910972 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-cni-binary-copy\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovnkube-script-lib\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911034 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-multus-certs\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-socket-dir-parent\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911136 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-run-multus-certs\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911144 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-daemon-config\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911138 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-multus-socket-dir-parent\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-cni-bin\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/181d637f-b639-4b48-ab70-bb7ab1d2f539-konnectivity-ca\") pod \"konnectivity-agent-x5nb4\" (UID: \"181d637f-b639-4b48-ab70-bb7ab1d2f539\") " pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911205 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovnkube-config\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911208 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-host-var-lib-cni-bin\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-system-cni-dir\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/006221a2-c572-4015-97af-6820d0ac7a4d-dbus\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-systemd\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911358 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911383 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-run-systemd\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911413 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dffbef86-9c16-4aee-b2cf-f2541f11d646-system-cni-dir\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911503 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/006221a2-c572-4015-97af-6820d0ac7a4d-dbus\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dffbef86-9c16-4aee-b2cf-f2541f11d646-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911739 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovnkube-script-lib\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.911742 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/181d637f-b639-4b48-ab70-bb7ab1d2f539-konnectivity-ca\") pod \"konnectivity-agent-x5nb4\" (UID: \"181d637f-b639-4b48-ab70-bb7ab1d2f539\") " pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.912720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.912286 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-ovn-node-metrics-cert\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.913561 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.913534 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/181d637f-b639-4b48-ab70-bb7ab1d2f539-agent-certs\") pod \"konnectivity-agent-x5nb4\" (UID: \"181d637f-b639-4b48-ab70-bb7ab1d2f539\") " pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:51.915719 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.915701 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:42:51.915719 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.915726 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:42:51.915719 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.915739 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:51.915982 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:51.915863 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:42:52.415828472 +0000 UTC m=+3.133166687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:51.918270 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.918238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thkkg\" (UniqueName: \"kubernetes.io/projected/5584f4ff-e7c2-442f-88f4-ade2ed3a6a82-kube-api-access-thkkg\") pod \"ovnkube-node-zvh7l\" (UID: \"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82\") " pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:51.918425 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.918323 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2ch\" (UniqueName: \"kubernetes.io/projected/dffbef86-9c16-4aee-b2cf-f2541f11d646-kube-api-access-ls2ch\") pod \"multus-additional-cni-plugins-fv9kd\" (UID: \"dffbef86-9c16-4aee-b2cf-f2541f11d646\") " pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:51.919015 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.918994 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-422l2\" (UniqueName: \"kubernetes.io/projected/17c4c290-15c8-48c3-9b0c-a7b47046dcb1-kube-api-access-422l2\") pod \"multus-mrgdx\" (UID: \"17c4c290-15c8-48c3-9b0c-a7b47046dcb1\") " pod="openshift-multus/multus-mrgdx" Jul 11 03:42:51.919240 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.919221 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85gr\" (UniqueName: \"kubernetes.io/projected/a821db1e-ce51-4d37-a3ef-f28cd63d41c1-kube-api-access-v85gr\") pod \"aws-ebs-csi-driver-node-kcb42\" (UID: \"a821db1e-ce51-4d37-a3ef-f28cd63d41c1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:51.999351 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:51.999259 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g9lsc" Jul 11 03:42:52.008567 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.008546 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" Jul 11 03:42:52.016509 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.016486 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pdfk6" Jul 11 03:42:52.021065 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.021042 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:42:52.022716 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.022693 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2h5c" Jul 11 03:42:52.030373 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.030352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mrgdx" Jul 11 03:42:52.037961 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.037942 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:42:52.044531 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.044514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" Jul 11 03:42:52.052044 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.052027 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:42:52.060029 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.060005 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" Jul 11 03:42:52.078426 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.078405 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 03:42:52.314589 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.314506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:52.314722 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.314674 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:52.314778 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.314767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:42:53.314737153 +0000 UTC m=+4.032075373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:52.415684 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.415655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:52.415829 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.415768 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:52.415829 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.415817 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:42:53.415804303 +0000 UTC m=+4.133142518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:52.516309 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.516275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:52.516439 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.516405 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:42:52.516439 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.516426 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:42:52.516439 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.516435 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:52.516577 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.516492 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:42:53.516472852 +0000 UTC m=+4.233811071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:52.702159 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.702002 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cd8457_4984_435a_b375_7befca8e0ea4.slice/crio-b4962b0d17c55bfd7a5f8a562fbc004537820b8b1b2b692e475a7224ace4b4db WatchSource:0}: Error finding container b4962b0d17c55bfd7a5f8a562fbc004537820b8b1b2b692e475a7224ace4b4db: Status 404 returned error can't find the container with id b4962b0d17c55bfd7a5f8a562fbc004537820b8b1b2b692e475a7224ace4b4db Jul 11 03:42:52.717549 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.717522 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c4c290_15c8_48c3_9b0c_a7b47046dcb1.slice/crio-ab11386c00fb91e71a1e6ecd089803aa8915c0630518c7e82cbc26af23f4b7dc WatchSource:0}: Error finding container ab11386c00fb91e71a1e6ecd089803aa8915c0630518c7e82cbc26af23f4b7dc: Status 404 returned error can't find the container with id ab11386c00fb91e71a1e6ecd089803aa8915c0630518c7e82cbc26af23f4b7dc Jul 11 03:42:52.717870 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.717830 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda821db1e_ce51_4d37_a3ef_f28cd63d41c1.slice/crio-38aea219245812be0462a50f0b234716517ad0275bd3f977accecd68c0504b77 WatchSource:0}: Error finding container 38aea219245812be0462a50f0b234716517ad0275bd3f977accecd68c0504b77: Status 404 returned error can't find the container with id 38aea219245812be0462a50f0b234716517ad0275bd3f977accecd68c0504b77 Jul 11 03:42:52.720030 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.719383 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181d637f_b639_4b48_ab70_bb7ab1d2f539.slice/crio-76790b6e26ccd87a26627ad6cbd3c02ab341c56808c85a356e548f6de00f672d WatchSource:0}: Error finding container 76790b6e26ccd87a26627ad6cbd3c02ab341c56808c85a356e548f6de00f672d: Status 404 returned error can't find the container with id 76790b6e26ccd87a26627ad6cbd3c02ab341c56808c85a356e548f6de00f672d Jul 11 03:42:52.720276 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.720245 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc1f308_409c_4eb8_8280_acf8adacb765.slice/crio-16eded58de81599cdb8a5ac476380e9f804c8f9be0f5174ad23e6a07d8cc1203 WatchSource:0}: Error finding container 16eded58de81599cdb8a5ac476380e9f804c8f9be0f5174ad23e6a07d8cc1203: Status 404 returned error can't find the container with id 16eded58de81599cdb8a5ac476380e9f804c8f9be0f5174ad23e6a07d8cc1203 Jul 11 03:42:52.721208 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.721191 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9800e7e_9028_4168_9e95_f980f495673b.slice/crio-3dcd53fbbbde2d965819e2437b969f907ee132aa81a6a0a2c35646e6ae2abd15 WatchSource:0}: Error finding container 3dcd53fbbbde2d965819e2437b969f907ee132aa81a6a0a2c35646e6ae2abd15: Status 404 returned error can't find the container with id 3dcd53fbbbde2d965819e2437b969f907ee132aa81a6a0a2c35646e6ae2abd15 Jul 11 03:42:52.722533 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.722434 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbcad89_cc95_48f3_9cfb_c53e0cb0c21e.slice/crio-444b57b8f54901dccd43c5e8e40755945b9bdc15e7a2f6ace3410f340ea30425 WatchSource:0}: Error finding container 444b57b8f54901dccd43c5e8e40755945b9bdc15e7a2f6ace3410f340ea30425: Status 404 returned error can't find the container with id 444b57b8f54901dccd43c5e8e40755945b9bdc15e7a2f6ace3410f340ea30425 Jul 11 03:42:52.724888 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:42:52.724865 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5584f4ff_e7c2_442f_88f4_ade2ed3a6a82.slice/crio-635a535b68dc0f0bc1afc9b9de4c932f59ec452762d286e0790bd689d1730f09 WatchSource:0}: Error finding container 635a535b68dc0f0bc1afc9b9de4c932f59ec452762d286e0790bd689d1730f09: Status 404 returned error can't find the container with id 635a535b68dc0f0bc1afc9b9de4c932f59ec452762d286e0790bd689d1730f09 Jul 11 03:42:52.735234 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.735195 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:37:51 +0000 UTC" deadline="2028-03-13 13:02:52.426344095 +0000 UTC" Jul 11 03:42:52.735234 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.735232 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14673h19m59.691114702s" Jul 11 03:42:52.829603 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.829580 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:52.829709 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:52.829671 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:42:52.841412 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.841378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9lsc" event={"ID":"4cc1f308-409c-4eb8-8280-acf8adacb765","Type":"ContainerStarted","Data":"16eded58de81599cdb8a5ac476380e9f804c8f9be0f5174ad23e6a07d8cc1203"} Jul 11 03:42:52.842462 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.842439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" event={"ID":"a821db1e-ce51-4d37-a3ef-f28cd63d41c1","Type":"ContainerStarted","Data":"38aea219245812be0462a50f0b234716517ad0275bd3f977accecd68c0504b77"} Jul 11 03:42:52.843398 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.843378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrgdx" event={"ID":"17c4c290-15c8-48c3-9b0c-a7b47046dcb1","Type":"ContainerStarted","Data":"ab11386c00fb91e71a1e6ecd089803aa8915c0630518c7e82cbc26af23f4b7dc"} Jul 11 03:42:52.844512 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.844492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2h5c" event={"ID":"22cd8457-4984-435a-b375-7befca8e0ea4","Type":"ContainerStarted","Data":"b4962b0d17c55bfd7a5f8a562fbc004537820b8b1b2b692e475a7224ace4b4db"} Jul 11 03:42:52.845472 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.845453 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerStarted","Data":"7b599eb6e844659fa84d68bd845dabedc4e8f7795e8e08a4335b08183f408202"} Jul 11 03:42:52.848474 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.848454 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"635a535b68dc0f0bc1afc9b9de4c932f59ec452762d286e0790bd689d1730f09"} Jul 11 03:42:52.849423 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.849403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" event={"ID":"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e","Type":"ContainerStarted","Data":"444b57b8f54901dccd43c5e8e40755945b9bdc15e7a2f6ace3410f340ea30425"} Jul 11 03:42:52.852612 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.852592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pdfk6" event={"ID":"e9800e7e-9028-4168-9e95-f980f495673b","Type":"ContainerStarted","Data":"3dcd53fbbbde2d965819e2437b969f907ee132aa81a6a0a2c35646e6ae2abd15"} Jul 11 03:42:52.854248 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.854228 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5nb4" event={"ID":"181d637f-b639-4b48-ab70-bb7ab1d2f539","Type":"ContainerStarted","Data":"76790b6e26ccd87a26627ad6cbd3c02ab341c56808c85a356e548f6de00f672d"} Jul 11 03:42:52.858607 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.858585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" event={"ID":"077fca01a64486b516cac217b95ed2fa","Type":"ContainerStarted","Data":"33b94c1169acf35e213c7def3303d7575b611bbd14e0fe561926e4c9101597ff"} Jul 11 03:42:52.871254 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:52.871214 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-101.ec2.internal" podStartSLOduration=1.871201847 podStartE2EDuration="1.871201847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:42:52.870665374 +0000 UTC m=+3.588003613" watchObservedRunningTime="2026-07-11 03:42:52.871201847 +0000 UTC m=+3.588540083" Jul 11 03:42:53.324542 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.324499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:53.324718 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.324647 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:53.324718 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.324716 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:42:55.324696967 +0000 UTC m=+6.042035187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:53.425560 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.425518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:53.425728 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.425675 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:53.425801 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.425744 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:42:55.425724043 +0000 UTC m=+6.143062262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:53.525950 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.525912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:53.526153 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.526134 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:42:53.526219 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.526165 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:42:53.526219 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.526178 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:53.526328 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.526235 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:42:55.526218287 +0000 UTC m=+6.243556508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:53.735923 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.735811 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 03:37:51 +0000 UTC" deadline="2028-02-14 02:29:46.708450955 +0000 UTC" Jul 11 03:42:53.735923 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.735872 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13990h46m52.972583544s" Jul 11 03:42:53.832667 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.832015 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:53.832667 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.832163 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:42:53.832667 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.832533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:53.832667 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:53.832623 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:42:53.875239 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.875205 2572 generic.go:356] "Generic (PLEG): container finished" podID="f0ff4a720fce2411438eb201c85e2744" containerID="cbac5ff4fd204cb1b9ad90e7de7038ea438cd8f327eedbf01a984a101bc5a825" exitCode=0 Jul 11 03:42:53.876176 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:53.876153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" event={"ID":"f0ff4a720fce2411438eb201c85e2744","Type":"ContainerDied","Data":"cbac5ff4fd204cb1b9ad90e7de7038ea438cd8f327eedbf01a984a101bc5a825"} Jul 11 03:42:54.830803 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:54.830321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:54.830803 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:54.830450 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:42:54.899913 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:54.899297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" event={"ID":"f0ff4a720fce2411438eb201c85e2744","Type":"ContainerStarted","Data":"d9f319d64eef5d0f24a12292de80fa8e6075556fa802b2ecb079229f2ce42aa4"} Jul 11 03:42:55.341070 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:55.341032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:55.341264 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.341236 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:55.341323 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.341303 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:42:59.341281659 +0000 UTC m=+10.058619879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:55.442278 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:55.441708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:55.442278 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.441871 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:55.442278 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.441936 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:42:59.441916873 +0000 UTC m=+10.159255092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:55.542279 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:55.542238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:55.542475 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.542435 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:42:55.542475 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.542459 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:42:55.542475 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.542472 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:55.542668 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.542533 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:42:59.542515011 +0000 UTC m=+10.259853240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:55.830654 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:55.830152 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:55.830654 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.830287 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:42:55.830654 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:55.830151 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:55.830654 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:55.830578 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:42:56.830353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:56.829897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:56.830353 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:56.830030 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:42:57.830534 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:57.830056 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:57.830534 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:57.830069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:57.830534 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:57.830186 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:42:57.830534 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:57.830265 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:42:58.830654 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:58.830165 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:58.830654 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:58.830289 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:42:59.375952 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:59.375888 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:59.376149 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.376036 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:59.376149 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.376123 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:07.376102774 +0000 UTC m=+18.093441000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:42:59.476944 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:59.476908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:42:59.477110 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.477079 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:59.477177 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.477133 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:43:07.477117128 +0000 UTC m=+18.194455345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:42:59.578346 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:59.578310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:59.578757 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.578731 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:42:59.578886 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.578762 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:42:59.578886 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.578779 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:59.578886 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.578882 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:43:07.578862308 +0000 UTC m=+18.296200539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:42:59.832390 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:59.832306 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:42:59.832872 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.832443 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:42:59.832872 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:42:59.832805 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:42:59.832946 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:42:59.832912 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:00.830268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:00.829831 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:00.830268 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:00.829977 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:01.829667 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:01.829628 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:01.830074 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:01.829757 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:01.830074 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:01.829932 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:01.830074 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:01.830048 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:02.830169 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:02.830104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:02.830618 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:02.830266 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:03.829834 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:03.829748 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:03.829834 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:03.829785 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:03.830069 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:03.829911 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:03.830069 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:03.830057 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:04.830423 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:04.830384 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:04.830867 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:04.830518 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:05.830491 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:05.830459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:05.830971 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:05.830460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:05.830971 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:05.830584 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:05.830971 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:05.830672 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:06.830420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:06.830384 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:06.830631 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:06.830533 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:07.434053 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:07.434004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:07.434204 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.434165 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:43:07.434267 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.434245 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:23.434224705 +0000 UTC m=+34.151562925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:43:07.535351 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:07.535263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:07.535498 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.535390 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:43:07.535498 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.535443 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:43:23.53542895 +0000 UTC m=+34.252767166 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:43:07.636529 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:07.636481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:07.636715 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.636684 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:43:07.636715 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.636708 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:43:07.636827 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.636723 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:43:07.636827 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.636790 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:43:23.636770219 +0000 UTC m=+34.354108438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:43:07.830574 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:07.830479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:07.830574 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:07.830499 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:07.831086 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.830620 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:07.831086 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:07.830760 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:08.830101 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:08.830069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:08.830252 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:08.830186 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:09.831067 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:09.831033 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:09.831521 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:09.831052 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:09.831521 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:09.831154 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:09.831521 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:09.831211 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:10.830146 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:10.830110 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:10.830294 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:10.830215 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:11.831508 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.830489 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:11.831508 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:11.830726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:11.831508 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.831074 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:11.831508 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:11.831136 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:11.937433 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.937082 2572 generic.go:356] "Generic (PLEG): container finished" podID="dffbef86-9c16-4aee-b2cf-f2541f11d646" containerID="4eecea6d855344d7d4b3d1ea7e8c22215367fc809516a1c770c124b6144aa716" exitCode=0 Jul 11 03:43:11.937433 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.937164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerDied","Data":"4eecea6d855344d7d4b3d1ea7e8c22215367fc809516a1c770c124b6144aa716"} Jul 11 03:43:11.940105 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.940072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"de3ba3deef1a36601b40e8b673a63f0d8767cfb9012777823b3f121d64f7efb5"} Jul 11 03:43:11.940194 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.940145 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"369358f8a1ecdb449c843731c5db7ac70df9f6a555ecb9292a1ae3ead2d74abb"} Jul 11 03:43:11.941875 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.941831 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" event={"ID":"4fbcad89-cc95-48f3-9cfb-c53e0cb0c21e","Type":"ContainerStarted","Data":"9da5646d8a6973140e556e56ca2d3d20cc2a1c9c3063c248af829681556f3e75"} Jul 11 03:43:11.943649 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.943619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pdfk6" event={"ID":"e9800e7e-9028-4168-9e95-f980f495673b","Type":"ContainerStarted","Data":"c76a070574b0a9109f42a58f3c199f0c2e9e2a18b044b83feb307de2ee6a675a"} Jul 11 03:43:11.945676 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.945655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x5nb4" event={"ID":"181d637f-b639-4b48-ab70-bb7ab1d2f539","Type":"ContainerStarted","Data":"b006c5a06ce4522a60153000bc6d7c20444d39ed0a99bfef40082be3ca933c45"} Jul 11 03:43:11.947234 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.947207 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" event={"ID":"a821db1e-ce51-4d37-a3ef-f28cd63d41c1","Type":"ContainerStarted","Data":"480aded893f77f78e27d7b450d3483df2ee1f3c7d75c08b5e15c84831eac5f45"} Jul 11 03:43:11.948784 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.948750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mrgdx" event={"ID":"17c4c290-15c8-48c3-9b0c-a7b47046dcb1","Type":"ContainerStarted","Data":"e6b45042059fba2331cd993b76b9a91c5d8078e8afb3c200988184571dc651a9"} Jul 11 03:43:11.950403 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.950384 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2h5c" event={"ID":"22cd8457-4984-435a-b375-7befca8e0ea4","Type":"ContainerStarted","Data":"3f541f38ea41a98b7f0bf1c231313257537aa4054b4c02b6cc41a706c2a21820"} Jul 11 03:43:11.960243 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.960197 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-101.ec2.internal" podStartSLOduration=20.960184894 podStartE2EDuration="20.960184894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:42:54.918110759 +0000 UTC m=+5.635448999" watchObservedRunningTime="2026-07-11 03:43:11.960184894 +0000 UTC m=+22.677523131" Jul 11 03:43:11.972238 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:11.972195 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x5nb4" podStartSLOduration=8.504059652 podStartE2EDuration="22.972178202s" totalImagesPullingTime="14.46811855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:11.972028262 +0000 UTC m=+22.689366500" watchObservedRunningTime="2026-07-11 03:43:11.972178202 +0000 UTC m=+22.689516437" Jul 11 03:43:12.002357 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.002321 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pdfk6" podStartSLOduration=4.147515871 podStartE2EDuration="23.002305267s" totalImagesPullingTime="18.854789396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:11.988941329 +0000 UTC m=+22.706279567" watchObservedRunningTime="2026-07-11 03:43:12.002305267 +0000 UTC m=+22.719643571" Jul 11 03:43:12.002455 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.002384 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m2h5c" podStartSLOduration=4.132653456 podStartE2EDuration="23.002380535s" totalImagesPullingTime="18.869727079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:12.002375833 +0000 UTC m=+22.719714069" watchObservedRunningTime="2026-07-11 03:43:12.002380535 +0000 UTC m=+22.719718772" Jul 11 03:43:12.017640 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.017534 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mrgdx" podStartSLOduration=4.093252626 podStartE2EDuration="23.017519988s" totalImagesPullingTime="18.924267362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:12.017074809 +0000 UTC m=+22.734413046" watchObservedRunningTime="2026-07-11 03:43:12.017519988 +0000 UTC m=+22.734858225" Jul 11 03:43:12.036176 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.036132 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7nfl7" podStartSLOduration=4.180646169 podStartE2EDuration="23.036119236s" totalImagesPullingTime="18.855473067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:12.035940344 +0000 UTC m=+22.753278577" watchObservedRunningTime="2026-07-11 03:43:12.036119236 +0000 UTC m=+22.753457485" Jul 11 03:43:12.829700 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.829672 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:12.829959 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:12.829793 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:12.956677 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.956598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"048eb53b0427703efc22f8a4f5ab5e49017041307060433ac4611685f3a6a715"} Jul 11 03:43:12.957264 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.956679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"f4abf2a3a33c818b0cf10755a17c27a6de19278c38204a2ee4814e5d403aa515"} Jul 11 03:43:12.957264 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.956723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"c273356864a155ee0ba7dc3d5eef4a32af7b822f89ddc635502fd31bd0c96439"} Jul 11 03:43:12.957264 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:12.956768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"506253720ea73804be0084e2edc1d47e78d1bb3b61079eb5e3f2c50bd2b84ab4"} Jul 11 03:43:13.177642 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.177593 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 11 03:43:13.771671 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.771558 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T03:43:13.17761089Z","UUID":"54e68aad-42bb-4184-ab05-7d46c5afdd19","Handler":null,"Name":"","Endpoint":""} Jul 11 03:43:13.773169 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.773147 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 11 03:43:13.773296 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.773177 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 11 03:43:13.830413 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.830381 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:13.830584 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:13.830516 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:13.830857 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.830381 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:13.830857 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:13.830795 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:13.965961 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.965834 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g9lsc" event={"ID":"4cc1f308-409c-4eb8-8280-acf8adacb765","Type":"ContainerStarted","Data":"39f8b80a5589fda24cf5d843730d3cd41f9337eca19ea4eeaea34a4752a585be"} Jul 11 03:43:13.968039 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.968009 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" event={"ID":"a821db1e-ce51-4d37-a3ef-f28cd63d41c1","Type":"ContainerStarted","Data":"1b7bedf8bc510b25fe33a60b43d6d4e0f36d5f3217873f0ca792f205d4106d85"} Jul 11 03:43:13.980251 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:13.980199 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g9lsc" podStartSLOduration=10.513885271 podStartE2EDuration="24.980179881s" totalImagesPullingTime="14.46629461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:13.979188891 +0000 UTC m=+24.696527127" watchObservedRunningTime="2026-07-11 03:43:13.980179881 +0000 UTC m=+24.697518120" Jul 11 03:43:14.594302 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.593994 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:43:14.594736 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.594719 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:43:14.830070 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.830035 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:14.830243 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:14.830159 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:14.973903 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.973859 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"6889eec8722770c6464e2f451332229e47040d3c0cd997876a6981047ebc1aef"} Jul 11 03:43:14.975979 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.975953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" event={"ID":"a821db1e-ce51-4d37-a3ef-f28cd63d41c1","Type":"ContainerStarted","Data":"a4a7998e392a4b28b78f7ec52b2fcf5d9343e85bb5a00e4b0803a33079964f40"} Jul 11 03:43:14.976250 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.976232 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 11 03:43:14.992372 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:14.992331 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcb42" podStartSLOduration=4.888486653 podStartE2EDuration="25.992317411s" totalImagesPullingTime="21.103830758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:14.991860344 +0000 UTC m=+25.709198575" watchObservedRunningTime="2026-07-11 03:43:14.992317411 +0000 UTC m=+25.709655655" Jul 11 03:43:15.830374 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:15.830342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:15.830543 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:15.830342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:15.830543 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:15.830490 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:15.830636 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:15.830556 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:16.830083 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:16.829828 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:16.830890 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:16.830096 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:16.983660 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:16.983624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" event={"ID":"5584f4ff-e7c2-442f-88f4-ade2ed3a6a82","Type":"ContainerStarted","Data":"d2acb0f245f854f5199893eb844912789847f9ac30cdad8d60a1a2f146e132a6"} Jul 11 03:43:16.983893 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:16.983869 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:43:16.984760 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:16.984257 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:43:16.988337 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:16.988314 2572 generic.go:356] "Generic (PLEG): container finished" podID="dffbef86-9c16-4aee-b2cf-f2541f11d646" containerID="c7334858f6d909840ea2708323645db6fd2f9627a92548ea028ae67554e41ae1" exitCode=0 Jul 11 03:43:16.988434 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:16.988342 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerDied","Data":"c7334858f6d909840ea2708323645db6fd2f9627a92548ea028ae67554e41ae1"} Jul 11 03:43:17.003286 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:17.003266 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:43:17.008528 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:17.008484 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" podStartSLOduration=9.092038416 podStartE2EDuration="28.00846751s" totalImagesPullingTime="18.916429094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:17.008434057 +0000 UTC m=+27.725772306" watchObservedRunningTime="2026-07-11 03:43:17.00846751 +0000 UTC m=+27.725805742" Jul 11 03:43:17.830202 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:17.830176 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:17.830597 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:17.830213 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:17.830597 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:17.830292 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:17.830597 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:17.830399 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:17.991349 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:17.991310 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:43:18.006681 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.006655 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:43:18.535456 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.533898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jfgct"] Jul 11 03:43:18.535456 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.534293 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:18.535456 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:18.534422 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:18.537016 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.536965 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2wlt"] Jul 11 03:43:18.537142 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.537088 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:18.537199 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:18.537178 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:18.537602 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.537573 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tq6x7"] Jul 11 03:43:18.537734 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.537697 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:18.537804 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:18.537789 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:18.874163 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.874131 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:43:18.874640 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.874257 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 11 03:43:18.874784 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.874769 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x5nb4" Jul 11 03:43:18.995438 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.995401 2572 generic.go:356] "Generic (PLEG): container finished" podID="dffbef86-9c16-4aee-b2cf-f2541f11d646" containerID="892292f3126c53ec84d5326802894e95db38b1d27ea63516469c7712c72b1884" exitCode=0 Jul 11 03:43:18.995600 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:18.995479 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerDied","Data":"892292f3126c53ec84d5326802894e95db38b1d27ea63516469c7712c72b1884"} Jul 11 03:43:19.830567 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:19.830535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:19.830750 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:19.830634 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:19.830750 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:19.830714 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:19.830885 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:19.830807 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:19.830885 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:19.830860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:19.831004 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:19.830913 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:21.002993 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:21.002957 2572 generic.go:356] "Generic (PLEG): container finished" podID="dffbef86-9c16-4aee-b2cf-f2541f11d646" containerID="adb53db7c2d44c59e8a16b74b486c035c91c676d82fb16bc2b6dc10f81d77764" exitCode=0 Jul 11 03:43:21.003597 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:21.003016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerDied","Data":"adb53db7c2d44c59e8a16b74b486c035c91c676d82fb16bc2b6dc10f81d77764"} Jul 11 03:43:21.829907 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:21.829870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:21.830094 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:21.829876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:21.830156 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:21.830112 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:21.830215 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:21.830013 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:21.830215 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:21.829876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:21.830309 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:21.830236 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:23.451728 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:23.451688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:23.452449 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.451887 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:43:23.452449 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.451963 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs podName:cd4b3579-8747-4027-ab5e-604679a76ef8 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:55.451946873 +0000 UTC m=+66.169285091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs") pod "network-metrics-daemon-tq6x7" (UID: "cd4b3579-8747-4027-ab5e-604679a76ef8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 03:43:23.552352 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:23.552268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:23.552493 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.552413 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 03:43:23.552493 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.552474 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret podName:006221a2-c572-4015-97af-6820d0ac7a4d nodeName:}" failed. No retries permitted until 2026-07-11 03:43:55.552458383 +0000 UTC m=+66.269796597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret") pod "global-pull-secret-syncer-jfgct" (UID: "006221a2-c572-4015-97af-6820d0ac7a4d") : object "kube-system"/"original-pull-secret" not registered Jul 11 03:43:23.653346 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:23.653309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:23.653539 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.653503 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 03:43:23.653539 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.653527 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 03:43:23.653539 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.653541 2572 projected.go:196] Error preparing data for projected volume kube-api-access-ccrxz for pod openshift-network-diagnostics/network-check-target-h2wlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:43:23.653739 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.653598 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz podName:b50acfff-5bca-486c-9757-29c225d1771b nodeName:}" failed. No retries permitted until 2026-07-11 03:43:55.653581501 +0000 UTC m=+66.370919716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccrxz" (UniqueName: "kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz") pod "network-check-target-h2wlt" (UID: "b50acfff-5bca-486c-9757-29c225d1771b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 03:43:23.830180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:23.830103 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:23.830331 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:23.830110 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:23.830331 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.830228 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:23.830331 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:23.830113 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:23.830331 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.830315 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:23.830545 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:23.830413 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:25.830065 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:25.829775 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:25.830065 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:25.829781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:25.830529 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:25.830092 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:25.830529 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:25.829854 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:25.830529 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:25.830133 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:25.830529 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:25.830203 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:26.019126 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:26.019090 2572 generic.go:356] "Generic (PLEG): container finished" podID="dffbef86-9c16-4aee-b2cf-f2541f11d646" containerID="1f1ba62daf0e58a023511956783edada3a09c947b255483d8b1de34bb1d4326e" exitCode=0 Jul 11 03:43:26.019277 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:26.019159 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerDied","Data":"1f1ba62daf0e58a023511956783edada3a09c947b255483d8b1de34bb1d4326e"} Jul 11 03:43:27.024105 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:27.024056 2572 generic.go:356] "Generic (PLEG): container finished" podID="dffbef86-9c16-4aee-b2cf-f2541f11d646" containerID="d8dcb26ddbe42a8a57f6454f2b96610973609a84aea76e64c7ed597ce884fee7" exitCode=0 Jul 11 03:43:27.024463 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:27.024133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerDied","Data":"d8dcb26ddbe42a8a57f6454f2b96610973609a84aea76e64c7ed597ce884fee7"} Jul 11 03:43:27.829563 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:27.829526 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:27.829721 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:27.829527 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:27.829721 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:27.829640 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:27.829721 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:27.829541 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:27.829721 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:27.829707 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:27.829871 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:27.829800 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:28.029782 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:28.029750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" event={"ID":"dffbef86-9c16-4aee-b2cf-f2541f11d646","Type":"ContainerStarted","Data":"162ceebc0eb9cdc8b33a678afb42b5623aa54f3c76d78de107ec5d6dc5ae53e5"} Jul 11 03:43:28.050850 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:28.050805 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fv9kd" podStartSLOduration=9.25489978 podStartE2EDuration="39.050791376s" totalImagesPullingTime="29.795891596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:28.049778202 +0000 UTC m=+38.767116440" watchObservedRunningTime="2026-07-11 03:43:28.050791376 +0000 UTC m=+38.768129613" Jul 11 03:43:29.830891 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:29.830855 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:29.831234 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:29.830949 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:29.831234 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:29.830961 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:29.831234 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:29.831033 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:29.831234 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:29.831058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:29.831234 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:29.831138 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:31.830247 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:31.830208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:31.830717 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:31.830212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:31.830717 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:31.830309 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:31.830717 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:31.830216 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:31.830717 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:31.830431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:31.830717 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:31.830473 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:33.829638 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:33.829602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:33.830084 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:33.829601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:33.830084 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:33.829736 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:33.830084 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:33.829750 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:33.830084 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:33.829834 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:33.830084 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:33.829959 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:35.832171 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:35.832139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:35.832623 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:35.832139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:35.832623 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:35.832236 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:35.832623 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:35.832139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:35.832623 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:35.832309 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:35.832623 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:35.832372 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:37.833356 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:37.833326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:37.833745 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:37.833424 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:37.833745 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:37.833439 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:37.833745 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:37.833462 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:37.833745 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:37.833599 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:37.833745 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:37.833652 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:39.831419 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:39.831375 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:39.831769 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:39.831494 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:39.831769 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:39.831508 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jfgct" podUID="006221a2-c572-4015-97af-6820d0ac7a4d" Jul 11 03:43:39.831769 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:39.831541 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:39.831769 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:39.831618 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2wlt" podUID="b50acfff-5bca-486c-9757-29c225d1771b" Jul 11 03:43:39.831769 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:39.831683 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tq6x7" podUID="cd4b3579-8747-4027-ab5e-604679a76ef8" Jul 11 03:43:41.591192 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.591158 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-101.ec2.internal" event="NodeReady" Jul 11 03:43:41.591562 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.591275 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 11 03:43:41.623662 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.623632 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bf484c99f-s52q2"] Jul 11 03:43:41.638213 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.638191 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.638213 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.638194 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rmkcf"] Jul 11 03:43:41.640631 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.640608 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 11 03:43:41.640770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.640660 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 11 03:43:41.640770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.640613 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nr2fs\"" Jul 11 03:43:41.640913 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.640893 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 11 03:43:41.650338 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.650307 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-78g6r"] Jul 11 03:43:41.650567 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.650329 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 11 03:43:41.650641 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.650409 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.652805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.652785 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 11 03:43:41.652975 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.652954 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qtgh\"" Jul 11 03:43:41.653041 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.653005 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 11 03:43:41.672109 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.672086 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bf484c99f-s52q2"] Jul 11 03:43:41.672195 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.672117 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-78g6r"] Jul 11 03:43:41.672195 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.672138 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rmkcf"] Jul 11 03:43:41.672195 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.672192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.674671 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.674635 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 11 03:43:41.674671 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.674637 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 11 03:43:41.674831 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.674678 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 11 03:43:41.674831 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.674694 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m57wb\"" Jul 11 03:43:41.786766 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ed2b65b-8820-46ab-bc3f-273dc72804c7-image-registry-private-configuration\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f80d714f-4a04-47ab-b109-52e06eaf91c9-metrics-tls\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2kbd\" (UniqueName: \"kubernetes.io/projected/e2d77764-4778-467c-9f4f-6006c747b166-kube-api-access-k2kbd\") pod \"ingress-canary-78g6r\" (UID: \"e2d77764-4778-467c-9f4f-6006c747b166\") " pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-bound-sa-token\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94d72\" (UniqueName: \"kubernetes.io/projected/f80d714f-4a04-47ab-b109-52e06eaf91c9-kube-api-access-94d72\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skh97\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-kube-api-access-skh97\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.786966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80d714f-4a04-47ab-b109-52e06eaf91c9-tmp-dir\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2d77764-4778-467c-9f4f-6006c747b166-cert\") pod \"ingress-canary-78g6r\" (UID: \"e2d77764-4778-467c-9f4f-6006c747b166\") " pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ed2b65b-8820-46ab-bc3f-273dc72804c7-ca-trust-extracted\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ed2b65b-8820-46ab-bc3f-273dc72804c7-registry-certificates\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787341 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ed2b65b-8820-46ab-bc3f-273dc72804c7-installation-pull-secrets\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787341 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f80d714f-4a04-47ab-b109-52e06eaf91c9-config-volume\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.787341 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-registry-tls\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.787341 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.787153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ed2b65b-8820-46ab-bc3f-273dc72804c7-trusted-ca\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.833009 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.832978 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:41.833135 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.833076 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:41.833135 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.833098 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:41.835528 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.835492 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 03:43:41.835528 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.835497 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 03:43:41.835737 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.835541 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 03:43:41.835737 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.835631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6d8m4\"" Jul 11 03:43:41.835737 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.835645 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-57qws\"" Jul 11 03:43:41.835890 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.835740 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 03:43:41.888149 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skh97\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-kube-api-access-skh97\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.888311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80d714f-4a04-47ab-b109-52e06eaf91c9-tmp-dir\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.888311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2d77764-4778-467c-9f4f-6006c747b166-cert\") pod \"ingress-canary-78g6r\" (UID: \"e2d77764-4778-467c-9f4f-6006c747b166\") " pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.888311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888194 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ed2b65b-8820-46ab-bc3f-273dc72804c7-ca-trust-extracted\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.888311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888301 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ed2b65b-8820-46ab-bc3f-273dc72804c7-registry-certificates\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.888505 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ed2b65b-8820-46ab-bc3f-273dc72804c7-installation-pull-secrets\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.888554 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f80d714f-4a04-47ab-b109-52e06eaf91c9-config-volume\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.888602 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888548 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-registry-tls\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.888602 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888572 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f80d714f-4a04-47ab-b109-52e06eaf91c9-tmp-dir\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.888694 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ed2b65b-8820-46ab-bc3f-273dc72804c7-ca-trust-extracted\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.888812 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ed2b65b-8820-46ab-bc3f-273dc72804c7-trusted-ca\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.889007 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.888990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ed2b65b-8820-46ab-bc3f-273dc72804c7-image-registry-private-configuration\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.889553 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f80d714f-4a04-47ab-b109-52e06eaf91c9-metrics-tls\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.889670 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2kbd\" (UniqueName: \"kubernetes.io/projected/e2d77764-4778-467c-9f4f-6006c747b166-kube-api-access-k2kbd\") pod \"ingress-canary-78g6r\" (UID: \"e2d77764-4778-467c-9f4f-6006c747b166\") " pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.889670 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889561 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ed2b65b-8820-46ab-bc3f-273dc72804c7-trusted-ca\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.889670 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-bound-sa-token\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.889892 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889111 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f80d714f-4a04-47ab-b109-52e06eaf91c9-config-volume\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.889892 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889338 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ed2b65b-8820-46ab-bc3f-273dc72804c7-registry-certificates\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.890016 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.889994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94d72\" (UniqueName: \"kubernetes.io/projected/f80d714f-4a04-47ab-b109-52e06eaf91c9-kube-api-access-94d72\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.892976 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.892956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2d77764-4778-467c-9f4f-6006c747b166-cert\") pod \"ingress-canary-78g6r\" (UID: \"e2d77764-4778-467c-9f4f-6006c747b166\") " pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.892976 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.892957 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f80d714f-4a04-47ab-b109-52e06eaf91c9-metrics-tls\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.893131 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.893040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ed2b65b-8820-46ab-bc3f-273dc72804c7-installation-pull-secrets\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.893131 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.893098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-registry-tls\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.893290 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.893266 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ed2b65b-8820-46ab-bc3f-273dc72804c7-image-registry-private-configuration\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.895993 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.895970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skh97\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-kube-api-access-skh97\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.897273 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.897241 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ed2b65b-8820-46ab-bc3f-273dc72804c7-bound-sa-token\") pod \"image-registry-7bf484c99f-s52q2\" (UID: \"7ed2b65b-8820-46ab-bc3f-273dc72804c7\") " pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.897370 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.897349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94d72\" (UniqueName: \"kubernetes.io/projected/f80d714f-4a04-47ab-b109-52e06eaf91c9-kube-api-access-94d72\") pod \"dns-default-rmkcf\" (UID: \"f80d714f-4a04-47ab-b109-52e06eaf91c9\") " pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.897470 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.897452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2kbd\" (UniqueName: \"kubernetes.io/projected/e2d77764-4778-467c-9f4f-6006c747b166-kube-api-access-k2kbd\") pod \"ingress-canary-78g6r\" (UID: \"e2d77764-4778-467c-9f4f-6006c747b166\") " pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:41.953423 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.953391 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:41.960532 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.960510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:41.979658 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:41.979635 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-78g6r" Jul 11 03:43:42.184450 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:42.184418 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bf484c99f-s52q2"] Jul 11 03:43:42.187983 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:42.187955 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed2b65b_8820_46ab_bc3f_273dc72804c7.slice/crio-243bb6de1aa6ac9323571ecc69b9c9d71aec90b8375943bf3f56072ec98e2a9a WatchSource:0}: Error finding container 243bb6de1aa6ac9323571ecc69b9c9d71aec90b8375943bf3f56072ec98e2a9a: Status 404 returned error can't find the container with id 243bb6de1aa6ac9323571ecc69b9c9d71aec90b8375943bf3f56072ec98e2a9a Jul 11 03:43:42.204199 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:42.204175 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-78g6r"] Jul 11 03:43:42.207324 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:42.207299 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rmkcf"] Jul 11 03:43:42.207611 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:42.207591 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d77764_4778_467c_9f4f_6006c747b166.slice/crio-677c8124b222451451f6a5c797464f9e8d72fa80073beda120fd5ff2116bb24d WatchSource:0}: Error finding container 677c8124b222451451f6a5c797464f9e8d72fa80073beda120fd5ff2116bb24d: Status 404 returned error can't find the container with id 677c8124b222451451f6a5c797464f9e8d72fa80073beda120fd5ff2116bb24d Jul 11 03:43:42.210360 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:42.210339 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80d714f_4a04_47ab_b109_52e06eaf91c9.slice/crio-88a9296c2f20075026e8d059bef6812c787384d3fb08853ae30570c184c5ebf9 WatchSource:0}: Error finding container 88a9296c2f20075026e8d059bef6812c787384d3fb08853ae30570c184c5ebf9: Status 404 returned error can't find the container with id 88a9296c2f20075026e8d059bef6812c787384d3fb08853ae30570c184c5ebf9 Jul 11 03:43:43.063367 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:43.063250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmkcf" event={"ID":"f80d714f-4a04-47ab-b109-52e06eaf91c9","Type":"ContainerStarted","Data":"88a9296c2f20075026e8d059bef6812c787384d3fb08853ae30570c184c5ebf9"} Jul 11 03:43:43.065292 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:43.065256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" event={"ID":"7ed2b65b-8820-46ab-bc3f-273dc72804c7","Type":"ContainerStarted","Data":"db84de65c7dd191fd07d81351c7ec18437e3c0617dadf764ab841169af008480"} Jul 11 03:43:43.065414 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:43.065315 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:43:43.065414 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:43.065336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" event={"ID":"7ed2b65b-8820-46ab-bc3f-273dc72804c7","Type":"ContainerStarted","Data":"243bb6de1aa6ac9323571ecc69b9c9d71aec90b8375943bf3f56072ec98e2a9a"} Jul 11 03:43:43.066451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:43.066430 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-78g6r" event={"ID":"e2d77764-4778-467c-9f4f-6006c747b166","Type":"ContainerStarted","Data":"677c8124b222451451f6a5c797464f9e8d72fa80073beda120fd5ff2116bb24d"} Jul 11 03:43:43.086082 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:43.086033 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" podStartSLOduration=3.086020507 podStartE2EDuration="3.086020507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:43.085093917 +0000 UTC m=+53.802432155" watchObservedRunningTime="2026-07-11 03:43:43.086020507 +0000 UTC m=+53.803358744" Jul 11 03:43:46.074419 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:46.074378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-78g6r" event={"ID":"e2d77764-4778-467c-9f4f-6006c747b166","Type":"ContainerStarted","Data":"6ab7fb19476fb601cdf94ea8857cdda27d98b9b9c7a847fd766c4436d2415fdc"} Jul 11 03:43:46.076060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:46.076035 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmkcf" event={"ID":"f80d714f-4a04-47ab-b109-52e06eaf91c9","Type":"ContainerStarted","Data":"dccac88678276eda3e4fc0021d98f9dda0618bd111a369edbe8ed5749f02a0e3"} Jul 11 03:43:46.076184 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:46.076076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rmkcf" event={"ID":"f80d714f-4a04-47ab-b109-52e06eaf91c9","Type":"ContainerStarted","Data":"d6971dc1c979952cdbd25711d712ff35061807f7be2f21de0751a1995b3204f3"} Jul 11 03:43:46.076184 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:46.076154 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:46.090143 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:46.090103 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-78g6r" podStartSLOduration=1.976902161 podStartE2EDuration="5.090091084s" totalImagesPullingTime="3.113188923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:46.089075424 +0000 UTC m=+56.806413664" watchObservedRunningTime="2026-07-11 03:43:46.090091084 +0000 UTC m=+56.807429299" Jul 11 03:43:46.107409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:46.107347 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rmkcf" podStartSLOduration=2.003371124 podStartE2EDuration="5.107327121s" totalImagesPullingTime="3.103955997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:46.106040488 +0000 UTC m=+56.823378726" watchObservedRunningTime="2026-07-11 03:43:46.107327121 +0000 UTC m=+56.824665360" Jul 11 03:43:48.727339 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.727309 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd"] Jul 11 03:43:48.729621 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.729603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:48.731767 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.731744 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 11 03:43:48.731914 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.731781 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9snw7\"" Jul 11 03:43:48.736882 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.736855 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd"] Jul 11 03:43:48.744995 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.744965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abe81ddc-dc5a-42f4-a0c6-fd2cab74b357-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fllsd\" (UID: \"abe81ddc-dc5a-42f4-a0c6-fd2cab74b357\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:48.810058 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.810027 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-8skgc"] Jul 11 03:43:48.811778 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.811763 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:43:48.813945 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.813923 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 11 03:43:48.814031 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.813954 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 11 03:43:48.814031 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.813965 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gsbp6\"" Jul 11 03:43:48.822665 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.822643 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-8skgc"] Jul 11 03:43:48.846036 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.846008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cp7p\" (UniqueName: \"kubernetes.io/projected/7f7d68f9-b251-4e30-8b36-9d1a72c3db75-kube-api-access-5cp7p\") pod \"downloads-68c9cbb497-8skgc\" (UID: \"7f7d68f9-b251-4e30-8b36-9d1a72c3db75\") " pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:43:48.846169 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.846057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abe81ddc-dc5a-42f4-a0c6-fd2cab74b357-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fllsd\" (UID: \"abe81ddc-dc5a-42f4-a0c6-fd2cab74b357\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:48.846169 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:48.846149 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 11 03:43:48.846291 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:48.846204 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe81ddc-dc5a-42f4-a0c6-fd2cab74b357-tls-certificates podName:abe81ddc-dc5a-42f4-a0c6-fd2cab74b357 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:49.346190469 +0000 UTC m=+60.063528685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/abe81ddc-dc5a-42f4-a0c6-fd2cab74b357-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-fllsd" (UID: "abe81ddc-dc5a-42f4-a0c6-fd2cab74b357") : secret "prometheus-operator-admission-webhook-tls" not found Jul 11 03:43:48.947199 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.947162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cp7p\" (UniqueName: \"kubernetes.io/projected/7f7d68f9-b251-4e30-8b36-9d1a72c3db75-kube-api-access-5cp7p\") pod \"downloads-68c9cbb497-8skgc\" (UID: \"7f7d68f9-b251-4e30-8b36-9d1a72c3db75\") " pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:43:48.957973 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:48.957947 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cp7p\" (UniqueName: \"kubernetes.io/projected/7f7d68f9-b251-4e30-8b36-9d1a72c3db75-kube-api-access-5cp7p\") pod \"downloads-68c9cbb497-8skgc\" (UID: \"7f7d68f9-b251-4e30-8b36-9d1a72c3db75\") " pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:43:49.120265 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.120233 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:43:49.249994 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.249957 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-8skgc"] Jul 11 03:43:49.313199 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.313167 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr"] Jul 11 03:43:49.315329 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.315314 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" Jul 11 03:43:49.317975 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.317949 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6vlsw\"" Jul 11 03:43:49.318105 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.318008 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 11 03:43:49.318639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.318602 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 11 03:43:49.326010 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.325987 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr"] Jul 11 03:43:49.349370 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.349331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj874\" (UniqueName: \"kubernetes.io/projected/9a3f1620-6ff3-4fa4-bd31-d890cb710ac6-kube-api-access-cj874\") pod \"migrator-7f59b54f6c-ghqdr\" (UID: \"9a3f1620-6ff3-4fa4-bd31-d890cb710ac6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" Jul 11 03:43:49.349522 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.349437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abe81ddc-dc5a-42f4-a0c6-fd2cab74b357-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fllsd\" (UID: \"abe81ddc-dc5a-42f4-a0c6-fd2cab74b357\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:49.352118 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.352077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abe81ddc-dc5a-42f4-a0c6-fd2cab74b357-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-fllsd\" (UID: \"abe81ddc-dc5a-42f4-a0c6-fd2cab74b357\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:49.372613 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.372545 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tgt5h"] Jul 11 03:43:49.374427 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.374407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.376508 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.376477 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 11 03:43:49.376508 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.376481 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 11 03:43:49.376654 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.376599 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 11 03:43:49.376726 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.376711 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ddl6z\"" Jul 11 03:43:49.376889 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.376873 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 11 03:43:49.387460 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.387436 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tgt5h"] Jul 11 03:43:49.450162 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.450126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.450162 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.450168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ac9160c-8272-496c-a725-28ac80d68d97-crio-socket\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.450355 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.450187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rltr\" (UniqueName: \"kubernetes.io/projected/9ac9160c-8272-496c-a725-28ac80d68d97-kube-api-access-6rltr\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.450355 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.450263 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.450355 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.450294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ac9160c-8272-496c-a725-28ac80d68d97-data-volume\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.450355 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.450349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj874\" (UniqueName: \"kubernetes.io/projected/9a3f1620-6ff3-4fa4-bd31-d890cb710ac6-kube-api-access-cj874\") pod \"migrator-7f59b54f6c-ghqdr\" (UID: \"9a3f1620-6ff3-4fa4-bd31-d890cb710ac6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" Jul 11 03:43:49.457956 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.457924 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj874\" (UniqueName: \"kubernetes.io/projected/9a3f1620-6ff3-4fa4-bd31-d890cb710ac6-kube-api-access-cj874\") pod \"migrator-7f59b54f6c-ghqdr\" (UID: \"9a3f1620-6ff3-4fa4-bd31-d890cb710ac6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" Jul 11 03:43:49.551149 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ac9160c-8272-496c-a725-28ac80d68d97-data-volume\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551324 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551324 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ac9160c-8272-496c-a725-28ac80d68d97-crio-socket\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551324 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rltr\" (UniqueName: \"kubernetes.io/projected/9ac9160c-8272-496c-a725-28ac80d68d97-kube-api-access-6rltr\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551324 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551302 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551526 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:49.551321 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:43:49.551526 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551340 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9ac9160c-8272-496c-a725-28ac80d68d97-crio-socket\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551526 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:49.551387 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:50.051371371 +0000 UTC m=+60.768709586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : configmap "kube-rbac-proxy" not found Jul 11 03:43:49.551526 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:49.551415 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:43:49.551526 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.551476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ac9160c-8272-496c-a725-28ac80d68d97-data-volume\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.551526 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:49.551486 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:50.051469709 +0000 UTC m=+60.768807940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : secret "insights-runtime-extractor-tls" not found Jul 11 03:43:49.560322 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.560298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rltr\" (UniqueName: \"kubernetes.io/projected/9ac9160c-8272-496c-a725-28ac80d68d97-kube-api-access-6rltr\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:49.626409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.626304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" Jul 11 03:43:49.638647 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.638625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:49.765294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.765265 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr"] Jul 11 03:43:49.768977 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:49.768952 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3f1620_6ff3_4fa4_bd31_d890cb710ac6.slice/crio-6e8ee0acc02f5ed535f19cd186fa648175b49f17a0e32ef3e6bfa7ff6b74098d WatchSource:0}: Error finding container 6e8ee0acc02f5ed535f19cd186fa648175b49f17a0e32ef3e6bfa7ff6b74098d: Status 404 returned error can't find the container with id 6e8ee0acc02f5ed535f19cd186fa648175b49f17a0e32ef3e6bfa7ff6b74098d Jul 11 03:43:49.775492 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:49.775470 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd"] Jul 11 03:43:49.777956 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:49.777934 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe81ddc_dc5a_42f4_a0c6_fd2cab74b357.slice/crio-fd451d7a2581a39095f7c8f5a1852832be677b1cfa8c9067cdd6e18e54ea00ed WatchSource:0}: Error finding container fd451d7a2581a39095f7c8f5a1852832be677b1cfa8c9067cdd6e18e54ea00ed: Status 404 returned error can't find the container with id fd451d7a2581a39095f7c8f5a1852832be677b1cfa8c9067cdd6e18e54ea00ed Jul 11 03:43:50.010865 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:50.010772 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zvh7l" Jul 11 03:43:50.056391 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:50.056350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:50.056582 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:50.056485 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:43:50.056582 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:50.056523 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:50.056582 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:50.056541 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:51.05652334 +0000 UTC m=+61.773861555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : secret "insights-runtime-extractor-tls" not found Jul 11 03:43:50.056929 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:50.056788 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:43:50.056929 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:50.056863 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:51.056822705 +0000 UTC m=+61.774160919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : configmap "kube-rbac-proxy" not found Jul 11 03:43:50.089018 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:50.088977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" event={"ID":"9a3f1620-6ff3-4fa4-bd31-d890cb710ac6","Type":"ContainerStarted","Data":"6e8ee0acc02f5ed535f19cd186fa648175b49f17a0e32ef3e6bfa7ff6b74098d"} Jul 11 03:43:50.090239 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:50.090212 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" event={"ID":"abe81ddc-dc5a-42f4-a0c6-fd2cab74b357","Type":"ContainerStarted","Data":"fd451d7a2581a39095f7c8f5a1852832be677b1cfa8c9067cdd6e18e54ea00ed"} Jul 11 03:43:50.091328 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:50.091303 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-8skgc" event={"ID":"7f7d68f9-b251-4e30-8b36-9d1a72c3db75","Type":"ContainerStarted","Data":"e969f440f160b4b34d13acbd4f1eaed2a3bc9fca5f63f7da70d4a1e988b21be3"} Jul 11 03:43:51.066049 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:51.066005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:51.066500 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:51.066096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:51.066500 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:51.066230 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:43:51.066500 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:51.066331 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:53.066309794 +0000 UTC m=+63.783648014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : configmap "kube-rbac-proxy" not found Jul 11 03:43:51.066802 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:51.066717 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:43:51.066802 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:51.066769 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:53.066756005 +0000 UTC m=+63.784094222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : secret "insights-runtime-extractor-tls" not found Jul 11 03:43:51.218584 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:51.218557 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmkcf_f80d714f-4a04-47ab-b109-52e06eaf91c9/dns/0.log" Jul 11 03:43:51.400220 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:51.400193 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmkcf_f80d714f-4a04-47ab-b109-52e06eaf91c9/kube-rbac-proxy/0.log" Jul 11 03:43:52.099218 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.099164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" event={"ID":"abe81ddc-dc5a-42f4-a0c6-fd2cab74b357","Type":"ContainerStarted","Data":"ae06960df7589ad44450e725f5257ba732a04ea8a4554959c6a956c0636c5188"} Jul 11 03:43:52.099642 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.099299 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:52.101704 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.101679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" event={"ID":"9a3f1620-6ff3-4fa4-bd31-d890cb710ac6","Type":"ContainerStarted","Data":"b8bb64cf5b8a1cdf0927a918bfccce3fb9b5325aca4d153ef9efb81506dad9d2"} Jul 11 03:43:52.101833 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.101725 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" event={"ID":"9a3f1620-6ff3-4fa4-bd31-d890cb710ac6","Type":"ContainerStarted","Data":"4c8fb240268d6908fc6eafce18415fbc6614ded492aa1e17df7fdd1f85e2424d"} Jul 11 03:43:52.104835 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.104814 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" Jul 11 03:43:52.114459 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.114410 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-fllsd" podStartSLOduration=2.6576189709999998 podStartE2EDuration="4.114391955s" totalImagesPullingTime="1.456772984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:52.11336891 +0000 UTC m=+62.830707151" watchObservedRunningTime="2026-07-11 03:43:52.114391955 +0000 UTC m=+62.831730195" Jul 11 03:43:52.126630 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.126584 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ghqdr" podStartSLOduration=1.659255748 podStartE2EDuration="3.126566977s" totalImagesPullingTime="1.467311229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:52.126061633 +0000 UTC m=+62.843399872" watchObservedRunningTime="2026-07-11 03:43:52.126566977 +0000 UTC m=+62.843905213" Jul 11 03:43:52.199615 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.199582 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pdfk6_e9800e7e-9028-4168-9e95-f980f495673b/dns-node-resolver/0.log" Jul 11 03:43:52.785873 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.785826 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hz8wp"] Jul 11 03:43:52.788140 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.788111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.790256 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.790231 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 11 03:43:52.791206 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.791186 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vvknq\"" Jul 11 03:43:52.791307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.791222 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 11 03:43:52.791307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.791269 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 11 03:43:52.791307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.791294 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 11 03:43:52.792009 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.791683 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 11 03:43:52.798638 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.798585 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hz8wp"] Jul 11 03:43:52.803152 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.803134 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bf484c99f-s52q2_7ed2b65b-8820-46ab-bc3f-273dc72804c7/registry/0.log" Jul 11 03:43:52.881595 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.881557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.881754 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.881606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.881797 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.881762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27aab0e0-e40e-4e58-89c9-781af6a8d276-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.881836 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.881826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkq86\" (UniqueName: \"kubernetes.io/projected/27aab0e0-e40e-4e58-89c9-781af6a8d276-kube-api-access-mkq86\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.982311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.982272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27aab0e0-e40e-4e58-89c9-781af6a8d276-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.982475 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.982353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkq86\" (UniqueName: \"kubernetes.io/projected/27aab0e0-e40e-4e58-89c9-781af6a8d276-kube-api-access-mkq86\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.982475 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.982415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.982475 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.982442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.982642 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:52.982542 2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 11 03:43:52.982642 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:52.982625 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-tls podName:27aab0e0-e40e-4e58-89c9-781af6a8d276 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:53.482603047 +0000 UTC m=+64.199941276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-tls") pod "prometheus-operator-64785b6675-hz8wp" (UID: "27aab0e0-e40e-4e58-89c9-781af6a8d276") : secret "prometheus-operator-tls" not found Jul 11 03:43:52.983107 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.983080 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27aab0e0-e40e-4e58-89c9-781af6a8d276-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.985117 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.985097 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:52.993083 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:52.993058 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkq86\" (UniqueName: \"kubernetes.io/projected/27aab0e0-e40e-4e58-89c9-781af6a8d276-kube-api-access-mkq86\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:53.000338 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.000305 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2h5c_22cd8457-4984-435a-b375-7befca8e0ea4/node-ca/0.log" Jul 11 03:43:53.083068 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.082988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:53.083068 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.083062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:53.083296 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:53.083127 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:43:53.083296 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:53.083186 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:43:53.083296 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:53.083224 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:57.083201806 +0000 UTC m=+67.800540034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : configmap "kube-rbac-proxy" not found Jul 11 03:43:53.083296 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:53.083242 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:57.083233605 +0000 UTC m=+67.800571820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : secret "insights-runtime-extractor-tls" not found Jul 11 03:43:53.486909 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.486876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:53.489801 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.489776 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/27aab0e0-e40e-4e58-89c9-781af6a8d276-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hz8wp\" (UID: \"27aab0e0-e40e-4e58-89c9-781af6a8d276\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:53.698212 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.698174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" Jul 11 03:43:53.801123 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.801060 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-78g6r_e2d77764-4778-467c-9f4f-6006c747b166/serve-healthcheck-canary/0.log" Jul 11 03:43:53.838415 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:53.838384 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hz8wp"] Jul 11 03:43:53.841642 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:53.841622 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27aab0e0_e40e_4e58_89c9_781af6a8d276.slice/crio-e9bb5e9b983390a76f91d9710d2f1df93d5ae6ed1142ba69d6c8f56943c70788 WatchSource:0}: Error finding container e9bb5e9b983390a76f91d9710d2f1df93d5ae6ed1142ba69d6c8f56943c70788: Status 404 returned error can't find the container with id e9bb5e9b983390a76f91d9710d2f1df93d5ae6ed1142ba69d6c8f56943c70788 Jul 11 03:43:54.110245 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:54.110164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" event={"ID":"27aab0e0-e40e-4e58-89c9-781af6a8d276","Type":"ContainerStarted","Data":"e9bb5e9b983390a76f91d9710d2f1df93d5ae6ed1142ba69d6c8f56943c70788"} Jul 11 03:43:54.400546 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:54.400465 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-ghqdr_9a3f1620-6ff3-4fa4-bd31-d890cb710ac6/migrator/0.log" Jul 11 03:43:54.600492 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:54.600456 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-ghqdr_9a3f1620-6ff3-4fa4-bd31-d890cb710ac6/graceful-termination/0.log" Jul 11 03:43:55.504829 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.504797 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:55.506959 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.506935 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 03:43:55.519242 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.519219 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4b3579-8747-4027-ab5e-604679a76ef8-metrics-certs\") pod \"network-metrics-daemon-tq6x7\" (UID: \"cd4b3579-8747-4027-ab5e-604679a76ef8\") " pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:55.606247 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.606162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:55.608338 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.608315 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 03:43:55.619640 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.619615 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/006221a2-c572-4015-97af-6820d0ac7a4d-original-pull-secret\") pod \"global-pull-secret-syncer-jfgct\" (UID: \"006221a2-c572-4015-97af-6820d0ac7a4d\") " pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:55.648984 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.648393 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jfgct" Jul 11 03:43:55.657555 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.654938 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6d8m4\"" Jul 11 03:43:55.666127 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.666101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tq6x7" Jul 11 03:43:55.708399 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.707143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:55.710043 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.710019 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 03:43:55.720930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.720714 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 03:43:55.734540 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.734359 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrxz\" (UniqueName: \"kubernetes.io/projected/b50acfff-5bca-486c-9757-29c225d1771b-kube-api-access-ccrxz\") pod \"network-check-target-h2wlt\" (UID: \"b50acfff-5bca-486c-9757-29c225d1771b\") " pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:55.800679 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.800410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jfgct"] Jul 11 03:43:55.803155 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:55.803129 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006221a2_c572_4015_97af_6820d0ac7a4d.slice/crio-0bba2f642b375c3d7ed6ad609c73a6c5a3e44f83c669412d3482b7398dc95c82 WatchSource:0}: Error finding container 0bba2f642b375c3d7ed6ad609c73a6c5a3e44f83c669412d3482b7398dc95c82: Status 404 returned error can't find the container with id 0bba2f642b375c3d7ed6ad609c73a6c5a3e44f83c669412d3482b7398dc95c82 Jul 11 03:43:55.824622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.824592 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tq6x7"] Jul 11 03:43:55.827150 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:55.827126 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4b3579_8747_4027_ab5e_604679a76ef8.slice/crio-adca607591b4076d61ad72f314faf9661bbf74fe4fcfb730564c7838ba44d14a WatchSource:0}: Error finding container adca607591b4076d61ad72f314faf9661bbf74fe4fcfb730564c7838ba44d14a: Status 404 returned error can't find the container with id adca607591b4076d61ad72f314faf9661bbf74fe4fcfb730564c7838ba44d14a Jul 11 03:43:55.944777 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.944702 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-57qws\"" Jul 11 03:43:55.953131 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:55.953108 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:43:56.080802 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.080776 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rmkcf" Jul 11 03:43:56.104584 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.104534 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2wlt"] Jul 11 03:43:56.106878 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:56.106833 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50acfff_5bca_486c_9757_29c225d1771b.slice/crio-d6e0b83229b1ed2f2469e78d7218c9ebc91fb02307ee4fc9788771650b43514a WatchSource:0}: Error finding container d6e0b83229b1ed2f2469e78d7218c9ebc91fb02307ee4fc9788771650b43514a: Status 404 returned error can't find the container with id d6e0b83229b1ed2f2469e78d7218c9ebc91fb02307ee4fc9788771650b43514a Jul 11 03:43:56.118452 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.118421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jfgct" event={"ID":"006221a2-c572-4015-97af-6820d0ac7a4d","Type":"ContainerStarted","Data":"0bba2f642b375c3d7ed6ad609c73a6c5a3e44f83c669412d3482b7398dc95c82"} Jul 11 03:43:56.120187 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.120123 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tq6x7" event={"ID":"cd4b3579-8747-4027-ab5e-604679a76ef8","Type":"ContainerStarted","Data":"adca607591b4076d61ad72f314faf9661bbf74fe4fcfb730564c7838ba44d14a"} Jul 11 03:43:56.122090 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.122064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" event={"ID":"27aab0e0-e40e-4e58-89c9-781af6a8d276","Type":"ContainerStarted","Data":"8772370120c212953875b90dab13487dea0c8e299d3c8b7e4d1d13d832d5c733"} Jul 11 03:43:56.122196 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.122115 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" event={"ID":"27aab0e0-e40e-4e58-89c9-781af6a8d276","Type":"ContainerStarted","Data":"29190395e9bae9a52a3b5b9df80c58896a7a3176a4172c683d0ec2e78e886bdb"} Jul 11 03:43:56.123872 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.123831 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2wlt" event={"ID":"b50acfff-5bca-486c-9757-29c225d1771b","Type":"ContainerStarted","Data":"d6e0b83229b1ed2f2469e78d7218c9ebc91fb02307ee4fc9788771650b43514a"} Jul 11 03:43:56.138708 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:56.138654 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-hz8wp" podStartSLOduration=2.558638453 podStartE2EDuration="4.138638011s" totalImagesPullingTime="1.579999558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:56.137876279 +0000 UTC m=+66.855214515" watchObservedRunningTime="2026-07-11 03:43:56.138638011 +0000 UTC m=+66.855976247" Jul 11 03:43:57.122236 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:57.121483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:57.122236 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:57.121564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:43:57.122236 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:57.121783 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 11 03:43:57.122236 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:57.121867 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:44:05.121829949 +0000 UTC m=+75.839168170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : secret "insights-runtime-extractor-tls" not found Jul 11 03:43:57.122236 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:57.122165 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 11 03:43:57.122236 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:57.122229 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm podName:9ac9160c-8272-496c-a725-28ac80d68d97 nodeName:}" failed. No retries permitted until 2026-07-11 03:44:05.122204539 +0000 UTC m=+75.839542756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tgt5h" (UID: "9ac9160c-8272-496c-a725-28ac80d68d97") : configmap "kube-rbac-proxy" not found Jul 11 03:43:57.130539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:57.130465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tq6x7" event={"ID":"cd4b3579-8747-4027-ab5e-604679a76ef8","Type":"ContainerStarted","Data":"dd0017e3bdaf1f976df0c860bde46cb667b5f32df680dc2a9f7fcdb4e174c180"} Jul 11 03:43:58.139881 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.139821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tq6x7" event={"ID":"cd4b3579-8747-4027-ab5e-604679a76ef8","Type":"ContainerStarted","Data":"3736642823b88cde4427404e4f07289e1716efe77dece6a4d0afd2104112b532"} Jul 11 03:43:58.150828 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.149296 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk"] Jul 11 03:43:58.172213 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.172118 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk"] Jul 11 03:43:58.172380 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.172319 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.176465 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.176406 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tq6x7" podStartSLOduration=67.999773697 podStartE2EDuration="1m9.176388455s" totalImagesPullingTime="1.176614758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:43:58.17041172 +0000 UTC m=+68.887749958" watchObservedRunningTime="2026-07-11 03:43:58.176388455 +0000 UTC m=+68.893726692" Jul 11 03:43:58.183533 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.183507 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gzjxz"] Jul 11 03:43:58.187389 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.184459 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l2ppv\"" Jul 11 03:43:58.187389 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.186460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 11 03:43:58.187389 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.186880 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 11 03:43:58.212446 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.212422 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ptkxg"] Jul 11 03:43:58.212608 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.212582 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.215700 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.214898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 11 03:43:58.215700 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.215315 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 11 03:43:58.215700 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.215543 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p7jcb\"" Jul 11 03:43:58.215951 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.215764 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 11 03:43:58.228570 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.228545 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gzjxz"] Jul 11 03:43:58.228696 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.228678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.231603 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.231578 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 11 03:43:58.231793 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.231776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 11 03:43:58.231987 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.231970 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 11 03:43:58.232160 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.232126 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mqg6h\"" Jul 11 03:43:58.233864 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.233138 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/737016a3-95e2-45a0-b9c8-ac1b9131c85b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.233864 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.233223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/737016a3-95e2-45a0-b9c8-ac1b9131c85b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.233864 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.233278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/737016a3-95e2-45a0-b9c8-ac1b9131c85b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.233864 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.233309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvkn4\" (UniqueName: \"kubernetes.io/projected/737016a3-95e2-45a0-b9c8-ac1b9131c85b-kube-api-access-tvkn4\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.333833 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.333803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-wtmp\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.333865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8z5\" (UniqueName: \"kubernetes.io/projected/2e653c35-1c03-4a15-87ad-4e144238dc2b-kube-api-access-7l8z5\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.333894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/737016a3-95e2-45a0-b9c8-ac1b9131c85b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.334023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.333934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.334023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.333958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mz29\" (UniqueName: \"kubernetes.io/projected/3ed2f4e0-419f-4431-945c-786f2239af78-kube-api-access-2mz29\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.334023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.333983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/737016a3-95e2-45a0-b9c8-ac1b9131c85b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.334023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-textfile\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e653c35-1c03-4a15-87ad-4e144238dc2b-metrics-client-ca\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-tls\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/737016a3-95e2-45a0-b9c8-ac1b9131c85b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkn4\" (UniqueName: \"kubernetes.io/projected/737016a3-95e2-45a0-b9c8-ac1b9131c85b-kube-api-access-tvkn4\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed2f4e0-419f-4431-945c-786f2239af78-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ed2f4e0-419f-4431-945c-786f2239af78-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334245 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-root\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.334319 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.334269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-sys\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.337349 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.335877 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/737016a3-95e2-45a0-b9c8-ac1b9131c85b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.338971 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.338908 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/737016a3-95e2-45a0-b9c8-ac1b9131c85b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.341029 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.341003 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/737016a3-95e2-45a0-b9c8-ac1b9131c85b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.347596 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.347572 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvkn4\" (UniqueName: \"kubernetes.io/projected/737016a3-95e2-45a0-b9c8-ac1b9131c85b-kube-api-access-tvkn4\") pod \"openshift-state-metrics-84bd68b896-mx7rk\" (UID: \"737016a3-95e2-45a0-b9c8-ac1b9131c85b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.434929 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.434811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.434929 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.434886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed2f4e0-419f-4431-945c-786f2239af78-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.434929 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.434919 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.434950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ed2f4e0-419f-4431-945c-786f2239af78-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:58.434973 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435025 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-root\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:58.435053 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-tls podName:3ed2f4e0-419f-4431-945c-786f2239af78 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:58.93503127 +0000 UTC m=+69.652369491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-gzjxz" (UID: "3ed2f4e0-419f-4431-945c-786f2239af78") : secret "kube-state-metrics-tls" not found Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.434975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-root\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435097 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-sys\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-wtmp\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435175 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8z5\" (UniqueName: \"kubernetes.io/projected/2e653c35-1c03-4a15-87ad-4e144238dc2b-kube-api-access-7l8z5\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mz29\" (UniqueName: \"kubernetes.io/projected/3ed2f4e0-419f-4431-945c-786f2239af78-kube-api-access-2mz29\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-textfile\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e653c35-1c03-4a15-87ad-4e144238dc2b-metrics-client-ca\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-tls\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.435799 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.435722 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed2f4e0-419f-4431-945c-786f2239af78-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.436032 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.436009 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3ed2f4e0-419f-4431-945c-786f2239af78-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.436110 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.436048 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-sys\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.436216 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.436194 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-wtmp\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.436413 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.436392 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.436489 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.436464 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-textfile\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.436977 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.436918 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.437178 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.437087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e653c35-1c03-4a15-87ad-4e144238dc2b-metrics-client-ca\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.439030 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.438995 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-tls\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.439479 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.439455 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.439795 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.439768 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e653c35-1c03-4a15-87ad-4e144238dc2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.452482 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.452437 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mz29\" (UniqueName: \"kubernetes.io/projected/3ed2f4e0-419f-4431-945c-786f2239af78-kube-api-access-2mz29\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.454072 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.454028 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8z5\" (UniqueName: \"kubernetes.io/projected/2e653c35-1c03-4a15-87ad-4e144238dc2b-kube-api-access-7l8z5\") pod \"node-exporter-ptkxg\" (UID: \"2e653c35-1c03-4a15-87ad-4e144238dc2b\") " pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.494707 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.494669 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" Jul 11 03:43:58.542819 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.542794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptkxg" Jul 11 03:43:58.577918 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:58.577892 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e653c35_1c03_4a15_87ad_4e144238dc2b.slice/crio-e5550f4303a69688663404a74123cebe98970ea9b0646d7cc678cd6901bab363 WatchSource:0}: Error finding container e5550f4303a69688663404a74123cebe98970ea9b0646d7cc678cd6901bab363: Status 404 returned error can't find the container with id e5550f4303a69688663404a74123cebe98970ea9b0646d7cc678cd6901bab363 Jul 11 03:43:58.690000 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.688943 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk"] Jul 11 03:43:58.725002 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.723716 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9f986458-8qnlh"] Jul 11 03:43:58.759370 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.759331 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9f986458-8qnlh"] Jul 11 03:43:58.759496 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.759456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.763863 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.763242 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 11 03:43:58.763863 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.763466 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 11 03:43:58.763863 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.763492 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 11 03:43:58.763863 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.763675 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 11 03:43:58.763863 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.763803 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6nww6\"" Jul 11 03:43:58.764298 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.763953 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 11 03:43:58.839599 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.839539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-oauth-serving-cert\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.839599 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.839587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-serving-cert\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.839818 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.839624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-oauth-config\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.839818 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.839752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-console-config\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.839818 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.839793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8m5p\" (UniqueName: \"kubernetes.io/projected/efb7cf29-1c62-48da-951b-39a9f9623619-kube-api-access-w8m5p\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.839996 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.839875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-service-ca\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.941457 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.941366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-console-config\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.941946 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.941917 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8m5p\" (UniqueName: \"kubernetes.io/projected/efb7cf29-1c62-48da-951b-39a9f9623619-kube-api-access-w8m5p\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.942053 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.941994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-service-ca\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.942113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.942068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.942113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.942108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-oauth-serving-cert\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.942232 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.942133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-serving-cert\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.942232 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.942164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-oauth-config\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.942985 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.942906 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-service-ca\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.943211 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.943150 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-oauth-serving-cert\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.944020 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.943911 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-console-config\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.946579 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.946546 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-oauth-config\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.947297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.947254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-serving-cert\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:58.947710 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.947688 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ed2f4e0-419f-4431-945c-786f2239af78-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gzjxz\" (UID: \"3ed2f4e0-419f-4431-945c-786f2239af78\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:58.957151 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:58.957123 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8m5p\" (UniqueName: \"kubernetes.io/projected/efb7cf29-1c62-48da-951b-39a9f9623619-kube-api-access-w8m5p\") pod \"console-5f9f986458-8qnlh\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:59.074497 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.074208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:43:59.126538 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.126510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" Jul 11 03:43:59.145811 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.145772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptkxg" event={"ID":"2e653c35-1c03-4a15-87ad-4e144238dc2b","Type":"ContainerStarted","Data":"e5550f4303a69688663404a74123cebe98970ea9b0646d7cc678cd6901bab363"} Jul 11 03:43:59.228169 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.227618 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:43:59.241216 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.241151 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.244622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244123 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nclt\"" Jul 11 03:43:59.244622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244315 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 11 03:43:59.244622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244339 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 11 03:43:59.244622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244482 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 11 03:43:59.244622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244575 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 11 03:43:59.244988 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 11 03:43:59.244988 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.244973 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 11 03:43:59.245134 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.245001 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 11 03:43:59.246013 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.245231 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 11 03:43:59.248965 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.248534 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 11 03:43:59.249737 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.249715 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344754 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpsm\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-kube-api-access-zqpsm\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-web-config\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.344990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.345029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.345054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.345072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.345088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.345111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-out\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.345321 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.345139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446135 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpsm\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-kube-api-access-zqpsm\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446294 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-web-config\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.446539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.446469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-out\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.447289 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.447262 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.447818 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:59.447785 2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 11 03:43:59.447818 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:59.447876 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls podName:63fece06-d21c-47ad-856b-3e05e42ab7b3 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:59.947835774 +0000 UTC m=+70.665174009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3") : secret "alertmanager-main-tls" not found Jul 11 03:43:59.449086 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:43:59.448437 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle podName:63fece06-d21c-47ad-856b-3e05e42ab7b3 nodeName:}" failed. No retries permitted until 2026-07-11 03:43:59.948419513 +0000 UTC m=+70.665757733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3") : configmap references non-existent config key: ca-bundle.crt Jul 11 03:43:59.449429 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.449402 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.451874 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.451852 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.451974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.451879 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.452394 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.452365 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.452481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.452437 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-out\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.452883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.452833 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.453527 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.453485 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.454010 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.453985 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.454751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.454710 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-web-config\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.464711 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.464690 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpsm\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-kube-api-access-zqpsm\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.949483 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:43:59.949447 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737016a3_95e2_45a0_b9c8_ac1b9131c85b.slice/crio-881f301dc045b77d479a549c990006be4adfd896dcb24a74a809d65e40c74ea3 WatchSource:0}: Error finding container 881f301dc045b77d479a549c990006be4adfd896dcb24a74a809d65e40c74ea3: Status 404 returned error can't find the container with id 881f301dc045b77d479a549c990006be4adfd896dcb24a74a809d65e40c74ea3 Jul 11 03:43:59.951542 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.951514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.951637 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.951576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.952658 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.952633 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:43:59.954906 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:43:59.954707 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:44:00.150537 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.150499 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" event={"ID":"737016a3-95e2-45a0-b9c8-ac1b9131c85b","Type":"ContainerStarted","Data":"881f301dc045b77d479a549c990006be4adfd896dcb24a74a809d65e40c74ea3"} Jul 11 03:44:00.156973 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.156937 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:44:00.337193 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.337117 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-546566c6bb-w4bzr"] Jul 11 03:44:00.340088 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.340065 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.342417 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.342388 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w9nrm\"" Jul 11 03:44:00.342541 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.342431 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 11 03:44:00.342601 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.342402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 11 03:44:00.342651 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.342610 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 11 03:44:00.342796 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.342782 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 11 03:44:00.344097 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.343143 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2qcrljooh68fm\"" Jul 11 03:44:00.344097 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.343218 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 11 03:44:00.353338 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.353316 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546566c6bb-w4bzr"] Jul 11 03:44:00.456958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.456926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-tls\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457149 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.456964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457149 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.456992 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-metrics-client-ca\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457149 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.457018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-grpc-tls\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457285 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.457144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fx88\" (UniqueName: \"kubernetes.io/projected/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-kube-api-access-4fx88\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457285 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.457184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457285 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.457230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.457285 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.457254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.557928 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.557818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-tls\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.557928 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.557886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.557928 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.557924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-metrics-client-ca\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.557928 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.557958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-grpc-tls\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.558286 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.558017 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fx88\" (UniqueName: \"kubernetes.io/projected/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-kube-api-access-4fx88\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.558286 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.558042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.558286 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.558088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.558286 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.558128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.558974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.558944 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-metrics-client-ca\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.561212 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.561182 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.561705 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.561680 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-tls\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.561800 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.561708 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.561800 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.561745 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.561934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.561818 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.561934 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.561906 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-secret-grpc-tls\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.565973 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.565953 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fx88\" (UniqueName: \"kubernetes.io/projected/7c8d98b1-e5cf-42a3-a07d-61b875fafac3-kube-api-access-4fx88\") pod \"thanos-querier-546566c6bb-w4bzr\" (UID: \"7c8d98b1-e5cf-42a3-a07d-61b875fafac3\") " pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:00.655133 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:00.655090 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:02.923189 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.923158 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl"] Jul 11 03:44:02.925971 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.925946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:02.928791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.928762 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 11 03:44:02.929014 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.928999 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mc9fk\"" Jul 11 03:44:02.935099 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.934898 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl"] Jul 11 03:44:02.984227 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.984188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2q7l\" (UniqueName: \"kubernetes.io/projected/849cc20b-6559-46ad-9a30-6f1fec7b7000-kube-api-access-c2q7l\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:02.984412 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:02.984378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849cc20b-6559-46ad-9a30-6f1fec7b7000-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:03.085128 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.085086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2q7l\" (UniqueName: \"kubernetes.io/projected/849cc20b-6559-46ad-9a30-6f1fec7b7000-kube-api-access-c2q7l\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:03.085311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.085211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849cc20b-6559-46ad-9a30-6f1fec7b7000-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:03.085379 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:44:03.085336 2572 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 11 03:44:03.085465 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:44:03.085400 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849cc20b-6559-46ad-9a30-6f1fec7b7000-monitoring-plugin-cert podName:849cc20b-6559-46ad-9a30-6f1fec7b7000 nodeName:}" failed. No retries permitted until 2026-07-11 03:44:03.585379322 +0000 UTC m=+74.302717559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/849cc20b-6559-46ad-9a30-6f1fec7b7000-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-g7pjl" (UID: "849cc20b-6559-46ad-9a30-6f1fec7b7000") : secret "monitoring-plugin-cert" not found Jul 11 03:44:03.093942 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.093887 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2q7l\" (UniqueName: \"kubernetes.io/projected/849cc20b-6559-46ad-9a30-6f1fec7b7000-kube-api-access-c2q7l\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:03.378386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.378350 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-787f45c9c6-nkdv8"] Jul 11 03:44:03.381082 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.381062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.383339 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.383316 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 11 03:44:03.383478 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.383402 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 11 03:44:03.383814 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.383794 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 11 03:44:03.383814 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.383806 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 11 03:44:03.383974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.383813 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 11 03:44:03.384412 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.384381 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9fg4k\"" Jul 11 03:44:03.391713 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.391685 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 11 03:44:03.399891 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.399865 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-787f45c9c6-nkdv8"] Jul 11 03:44:03.489160 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489111 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-serving-certs-ca-bundle\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489331 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-secret-telemeter-client\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489331 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-federate-client-tls\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489331 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-telemeter-client-tls\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489331 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489517 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489363 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489517 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b79z5\" (UniqueName: \"kubernetes.io/projected/095cfff8-02f2-48f6-ad68-67d6268aea7b-kube-api-access-b79z5\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.489517 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.489423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-metrics-client-ca\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590095 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-serving-certs-ca-bundle\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590264 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-secret-telemeter-client\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590264 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-federate-client-tls\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-telemeter-client-tls\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849cc20b-6559-46ad-9a30-6f1fec7b7000-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:03.590386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590540 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.590540 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b79z5\" (UniqueName: \"kubernetes.io/projected/095cfff8-02f2-48f6-ad68-67d6268aea7b-kube-api-access-b79z5\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.591037 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.590893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-metrics-client-ca\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.591230 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.591187 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-serving-certs-ca-bundle\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.591491 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.591468 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.592023 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.591980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/095cfff8-02f2-48f6-ad68-67d6268aea7b-metrics-client-ca\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.594051 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.593503 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849cc20b-6559-46ad-9a30-6f1fec7b7000-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-g7pjl\" (UID: \"849cc20b-6559-46ad-9a30-6f1fec7b7000\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:03.594051 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.594015 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-federate-client-tls\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.594213 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.594140 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-secret-telemeter-client\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.594324 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.594297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-telemeter-client-tls\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.594465 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.594441 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/095cfff8-02f2-48f6-ad68-67d6268aea7b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.598703 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.598679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b79z5\" (UniqueName: \"kubernetes.io/projected/095cfff8-02f2-48f6-ad68-67d6268aea7b-kube-api-access-b79z5\") pod \"telemeter-client-787f45c9c6-nkdv8\" (UID: \"095cfff8-02f2-48f6-ad68-67d6268aea7b\") " pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.696182 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.696089 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" Jul 11 03:44:03.838986 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:03.838957 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:04.074792 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:04.074706 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bf484c99f-s52q2" Jul 11 03:44:05.209984 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:05.209946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:44:05.210396 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:05.210074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:44:05.210686 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:05.210659 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9ac9160c-8272-496c-a725-28ac80d68d97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:44:05.212623 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:05.212592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9ac9160c-8272-496c-a725-28ac80d68d97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tgt5h\" (UID: \"9ac9160c-8272-496c-a725-28ac80d68d97\") " pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:44:05.285391 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:05.285349 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ddl6z\"" Jul 11 03:44:05.294180 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:05.294152 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tgt5h" Jul 11 03:44:07.110293 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.110260 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c99ccc7fd-dk5sm"] Jul 11 03:44:07.115419 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.115389 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.122630 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.122439 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 11 03:44:07.125365 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.125328 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c99ccc7fd-dk5sm"] Jul 11 03:44:07.230448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-serving-cert\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.230643 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-oauth-config\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.230643 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-config\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.230643 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-oauth-serving-cert\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.230791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qdts\" (UniqueName: \"kubernetes.io/projected/4e6ec33f-3f8e-4392-b891-19e76f6886f3-kube-api-access-2qdts\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.230791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-service-ca\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.230791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.230760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-trusted-ca-bundle\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.331773 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.331731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-oauth-serving-cert\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.331958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.331795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qdts\" (UniqueName: \"kubernetes.io/projected/4e6ec33f-3f8e-4392-b891-19e76f6886f3-kube-api-access-2qdts\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.331958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.331827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-service-ca\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.331958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.331865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-trusted-ca-bundle\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.332130 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-serving-cert\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.332130 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-oauth-config\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.332130 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332125 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-config\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.332597 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332563 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-oauth-serving-cert\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.332893 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332869 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-service-ca\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.333164 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332890 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-trusted-ca-bundle\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.333164 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.332908 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-config\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.334863 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.334825 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-serving-cert\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.335026 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.334997 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-oauth-config\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.339664 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.339644 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qdts\" (UniqueName: \"kubernetes.io/projected/4e6ec33f-3f8e-4392-b891-19e76f6886f3-kube-api-access-2qdts\") pod \"console-5c99ccc7fd-dk5sm\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:07.427338 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:07.427252 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:09.017773 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.017546 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gzjxz"] Jul 11 03:44:09.039015 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.037733 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9f986458-8qnlh"] Jul 11 03:44:09.090592 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.090157 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl"] Jul 11 03:44:09.116065 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.116036 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546566c6bb-w4bzr"] Jul 11 03:44:09.132437 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.132409 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:44:09.191556 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.191484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jfgct" event={"ID":"006221a2-c572-4015-97af-6820d0ac7a4d","Type":"ContainerStarted","Data":"419e78a541769aa577f468fed7b952b240cc5e3a8e0dd9d9490a14d02789f186"} Jul 11 03:44:09.193258 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.193221 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" event={"ID":"737016a3-95e2-45a0-b9c8-ac1b9131c85b","Type":"ContainerStarted","Data":"6231bc5a5104a64e526a8bc10f9e63a31e5d22c264954465dc9b5b56f161d1e7"} Jul 11 03:44:09.194796 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.194769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2wlt" event={"ID":"b50acfff-5bca-486c-9757-29c225d1771b","Type":"ContainerStarted","Data":"98049261bf59528ba9f3d69e7edeea29d9f82a26425724d822c610c712e15257"} Jul 11 03:44:09.195174 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.195156 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:44:09.206440 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.206393 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jfgct" podStartSLOduration=67.241495231 podStartE2EDuration="1m20.206379337s" totalImagesPullingTime="12.964884106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:09.20546584 +0000 UTC m=+79.922804078" watchObservedRunningTime="2026-07-11 03:44:09.206379337 +0000 UTC m=+79.923717605" Jul 11 03:44:09.219375 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.219052 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2wlt" podStartSLOduration=67.563597446 podStartE2EDuration="1m20.219009207s" totalImagesPullingTime="12.655411761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:42:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:09.218373009 +0000 UTC m=+79.935711252" watchObservedRunningTime="2026-07-11 03:44:09.219009207 +0000 UTC m=+79.936347446" Jul 11 03:44:09.304613 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.304412 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849cc20b_6559_46ad_9a30_6f1fec7b7000.slice/crio-48f993cfdaaf03dca4fa63bfc92625f9a5404880424a9c402282fc1d55e6a617 WatchSource:0}: Error finding container 48f993cfdaaf03dca4fa63bfc92625f9a5404880424a9c402282fc1d55e6a617: Status 404 returned error can't find the container with id 48f993cfdaaf03dca4fa63bfc92625f9a5404880424a9c402282fc1d55e6a617 Jul 11 03:44:09.305044 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.305019 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fece06_d21c_47ad_856b_3e05e42ab7b3.slice/crio-47c6ee8b3c9d1002232fa812190fbe548ccf4feb6dc23f701ba2a77712c97677 WatchSource:0}: Error finding container 47c6ee8b3c9d1002232fa812190fbe548ccf4feb6dc23f701ba2a77712c97677: Status 404 returned error can't find the container with id 47c6ee8b3c9d1002232fa812190fbe548ccf4feb6dc23f701ba2a77712c97677 Jul 11 03:44:09.305887 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.305863 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb7cf29_1c62_48da_951b_39a9f9623619.slice/crio-82e5b01c5550270c68b948aaeae8258a84409c20cc2ba30fcd5e4a3e2ee6b3ea WatchSource:0}: Error finding container 82e5b01c5550270c68b948aaeae8258a84409c20cc2ba30fcd5e4a3e2ee6b3ea: Status 404 returned error can't find the container with id 82e5b01c5550270c68b948aaeae8258a84409c20cc2ba30fcd5e4a3e2ee6b3ea Jul 11 03:44:09.307037 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.306938 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed2f4e0_419f_4431_945c_786f2239af78.slice/crio-17b15b3616b415eb468534414e2328958782cf266c277fdfae95d233510ec00c WatchSource:0}: Error finding container 17b15b3616b415eb468534414e2328958782cf266c277fdfae95d233510ec00c: Status 404 returned error can't find the container with id 17b15b3616b415eb468534414e2328958782cf266c277fdfae95d233510ec00c Jul 11 03:44:09.308339 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.308234 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8d98b1_e5cf_42a3_a07d_61b875fafac3.slice/crio-3d937550dc92c975d95d689b134b8f9ad87667e7ad27096e415d31d40fcf7897 WatchSource:0}: Error finding container 3d937550dc92c975d95d689b134b8f9ad87667e7ad27096e415d31d40fcf7897: Status 404 returned error can't find the container with id 3d937550dc92c975d95d689b134b8f9ad87667e7ad27096e415d31d40fcf7897 Jul 11 03:44:09.344406 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.344224 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tgt5h"] Jul 11 03:44:09.351559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.351530 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-787f45c9c6-nkdv8"] Jul 11 03:44:09.354415 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:09.354394 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c99ccc7fd-dk5sm"] Jul 11 03:44:09.431022 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.430983 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac9160c_8272_496c_a725_28ac80d68d97.slice/crio-de67902cc640fc9d095d479d3383633128b7a913a06b36aa057c041730b29e48 WatchSource:0}: Error finding container de67902cc640fc9d095d479d3383633128b7a913a06b36aa057c041730b29e48: Status 404 returned error can't find the container with id de67902cc640fc9d095d479d3383633128b7a913a06b36aa057c041730b29e48 Jul 11 03:44:09.432339 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.432312 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095cfff8_02f2_48f6_ad68_67d6268aea7b.slice/crio-756ed13e2e396d85857c2e9ea7bdd15f78b8ffb77bde13b6b32f3004ce3a788d WatchSource:0}: Error finding container 756ed13e2e396d85857c2e9ea7bdd15f78b8ffb77bde13b6b32f3004ce3a788d: Status 404 returned error can't find the container with id 756ed13e2e396d85857c2e9ea7bdd15f78b8ffb77bde13b6b32f3004ce3a788d Jul 11 03:44:09.432587 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:44:09.432564 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ec33f_3f8e_4392_b891_19e76f6886f3.slice/crio-1eb3c8f517c945462851b4332fc82720ccb368fb2f1f9611eb98ed141eb475aa WatchSource:0}: Error finding container 1eb3c8f517c945462851b4332fc82720ccb368fb2f1f9611eb98ed141eb475aa: Status 404 returned error can't find the container with id 1eb3c8f517c945462851b4332fc82720ccb368fb2f1f9611eb98ed141eb475aa Jul 11 03:44:10.248244 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.248132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" event={"ID":"737016a3-95e2-45a0-b9c8-ac1b9131c85b","Type":"ContainerStarted","Data":"307cd6947248ba3d727169099838f1a591bf4aa06f145dfd2c8467951ea579aa"} Jul 11 03:44:10.258271 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.258175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgt5h" event={"ID":"9ac9160c-8272-496c-a725-28ac80d68d97","Type":"ContainerStarted","Data":"de67902cc640fc9d095d479d3383633128b7a913a06b36aa057c041730b29e48"} Jul 11 03:44:10.282388 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.282346 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c99ccc7fd-dk5sm" event={"ID":"4e6ec33f-3f8e-4392-b891-19e76f6886f3","Type":"ContainerStarted","Data":"1eb3c8f517c945462851b4332fc82720ccb368fb2f1f9611eb98ed141eb475aa"} Jul 11 03:44:10.306976 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.306821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"47c6ee8b3c9d1002232fa812190fbe548ccf4feb6dc23f701ba2a77712c97677"} Jul 11 03:44:10.349420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.349378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-8skgc" event={"ID":"7f7d68f9-b251-4e30-8b36-9d1a72c3db75","Type":"ContainerStarted","Data":"d7fb9b302f89efa169a8a0e3db0653c080fe2ef9c5416f218c7a0caf07528a83"} Jul 11 03:44:10.350472 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.350413 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:44:10.367818 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.367037 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-8skgc" Jul 11 03:44:10.372789 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.371290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"3d937550dc92c975d95d689b134b8f9ad87667e7ad27096e415d31d40fcf7897"} Jul 11 03:44:10.376099 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.373443 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-8skgc" podStartSLOduration=2.195759399 podStartE2EDuration="22.373425603s" totalImagesPullingTime="20.177666204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:10.36680307 +0000 UTC m=+81.084141311" watchObservedRunningTime="2026-07-11 03:44:10.373425603 +0000 UTC m=+81.090763841" Jul 11 03:44:10.376099 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.379334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" event={"ID":"849cc20b-6559-46ad-9a30-6f1fec7b7000","Type":"ContainerStarted","Data":"48f993cfdaaf03dca4fa63bfc92625f9a5404880424a9c402282fc1d55e6a617"} Jul 11 03:44:10.385655 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.383868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9f986458-8qnlh" event={"ID":"efb7cf29-1c62-48da-951b-39a9f9623619","Type":"ContainerStarted","Data":"82e5b01c5550270c68b948aaeae8258a84409c20cc2ba30fcd5e4a3e2ee6b3ea"} Jul 11 03:44:10.388467 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.388434 2572 generic.go:356] "Generic (PLEG): container finished" podID="2e653c35-1c03-4a15-87ad-4e144238dc2b" containerID="35e75b3994ecf4d33fc5302acdeb2ffc668d210aaaaedbe7c35a205f1f875969" exitCode=0 Jul 11 03:44:10.388588 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.388545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptkxg" event={"ID":"2e653c35-1c03-4a15-87ad-4e144238dc2b","Type":"ContainerDied","Data":"35e75b3994ecf4d33fc5302acdeb2ffc668d210aaaaedbe7c35a205f1f875969"} Jul 11 03:44:10.418796 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.418761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" event={"ID":"095cfff8-02f2-48f6-ad68-67d6268aea7b","Type":"ContainerStarted","Data":"756ed13e2e396d85857c2e9ea7bdd15f78b8ffb77bde13b6b32f3004ce3a788d"} Jul 11 03:44:10.433122 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:10.433068 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" event={"ID":"3ed2f4e0-419f-4431-945c-786f2239af78","Type":"ContainerStarted","Data":"17b15b3616b415eb468534414e2328958782cf266c277fdfae95d233510ec00c"} Jul 11 03:44:11.462714 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:11.462671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptkxg" event={"ID":"2e653c35-1c03-4a15-87ad-4e144238dc2b","Type":"ContainerStarted","Data":"c685de481255b9e8224fffaec041d616a79df2881d8df36627abdbad637cf020"} Jul 11 03:44:22.528267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.528166 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"a74b9d0df27cec3180cb075e2b85cdf9ff36791c0c29283d878b2aa010fa5c6c"} Jul 11 03:44:22.528267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.528252 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"a8cfe66c8280c500cc3af2737060472788fb3443ffab7e47f1f48cf884ec7a47"} Jul 11 03:44:22.528725 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.528292 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"64282fbc32f755d9b51ab3caa6cf67860a691e2d1356bba22fa1f7e091a82572"} Jul 11 03:44:22.529951 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.529924 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" event={"ID":"849cc20b-6559-46ad-9a30-6f1fec7b7000","Type":"ContainerStarted","Data":"054f17820aed736e39207bdbfeac3617a354953a6ae3c80c70fe31df873e48c2"} Jul 11 03:44:22.530163 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.530108 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:22.531639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.531618 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9f986458-8qnlh" event={"ID":"efb7cf29-1c62-48da-951b-39a9f9623619","Type":"ContainerStarted","Data":"e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7"} Jul 11 03:44:22.534300 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.534275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptkxg" event={"ID":"2e653c35-1c03-4a15-87ad-4e144238dc2b","Type":"ContainerStarted","Data":"89e711a331fbeb3798493926a12a670900e9aef840165565945bfcaf36e772af"} Jul 11 03:44:22.536308 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.536292 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" Jul 11 03:44:22.536796 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.536772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" event={"ID":"095cfff8-02f2-48f6-ad68-67d6268aea7b","Type":"ContainerStarted","Data":"8f771c6da5116dc235e46dcf515eb03271fbe1f83eaa8c838741d4e18095d6d0"} Jul 11 03:44:22.536914 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.536822 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" event={"ID":"095cfff8-02f2-48f6-ad68-67d6268aea7b","Type":"ContainerStarted","Data":"9b06206e4a66f2f8e670dfd1553cc2c4a98b4e3a8af7ec67b0de45abf2901571"} Jul 11 03:44:22.536914 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.536880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" event={"ID":"095cfff8-02f2-48f6-ad68-67d6268aea7b","Type":"ContainerStarted","Data":"8d1be9fedd9d0fbb49e693ec2dd9824f5ff91342e1fbf19c9de254ed539be095"} Jul 11 03:44:22.538987 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.538955 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" event={"ID":"3ed2f4e0-419f-4431-945c-786f2239af78","Type":"ContainerStarted","Data":"17ad262a1399a2a163b1ec2d0f6f8c222312eca19218a1fe6d524aa36ad63d90"} Jul 11 03:44:22.539084 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.539007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" event={"ID":"3ed2f4e0-419f-4431-945c-786f2239af78","Type":"ContainerStarted","Data":"065f13f3d996d57e0c94150589e2f380466e36ae89a36b15ba73b1cd3e8ecab7"} Jul 11 03:44:22.539084 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.539037 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" event={"ID":"3ed2f4e0-419f-4431-945c-786f2239af78","Type":"ContainerStarted","Data":"4c0ff3319867f0b6b3c5b48d4ccbb2afcb8cabeddc1a5b3f3c7d252bbf073eaf"} Jul 11 03:44:22.541072 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.541052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" event={"ID":"737016a3-95e2-45a0-b9c8-ac1b9131c85b","Type":"ContainerStarted","Data":"9c3821310dea234f57d3a27da72eabd69e0cd49b57500b30ae4977c174806f67"} Jul 11 03:44:22.542567 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.542536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgt5h" event={"ID":"9ac9160c-8272-496c-a725-28ac80d68d97","Type":"ContainerStarted","Data":"f884bfa6393575797bf7f8dedadbb60cdbc2bdfb04514e913c5ff8714aa5c9e9"} Jul 11 03:44:22.543998 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.543978 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c99ccc7fd-dk5sm" event={"ID":"4e6ec33f-3f8e-4392-b891-19e76f6886f3","Type":"ContainerStarted","Data":"eebe7251d3a306801195bbebd87c61184998807dc47f075b6b5a7c4abf266343"} Jul 11 03:44:22.546598 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.546561 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-g7pjl" podStartSLOduration=8.14855128 podStartE2EDuration="20.546549453s" totalImagesPullingTime="12.397998173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:44:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.544672036 +0000 UTC m=+93.262010274" watchObservedRunningTime="2026-07-11 03:44:22.546549453 +0000 UTC m=+93.263887691" Jul 11 03:44:22.546820 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.546742 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="6ce53fab66fe735476b1b9a394d734ae66bfa19427143f91d6dc304761073f76" exitCode=0 Jul 11 03:44:22.546820 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.546770 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"6ce53fab66fe735476b1b9a394d734ae66bfa19427143f91d6dc304761073f76"} Jul 11 03:44:22.563199 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.563144 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-787f45c9c6-nkdv8" podStartSLOduration=7.2922823 podStartE2EDuration="19.56313105s" totalImagesPullingTime="12.27084875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.562307422 +0000 UTC m=+93.279645661" watchObservedRunningTime="2026-07-11 03:44:22.56313105 +0000 UTC m=+93.280469287" Jul 11 03:44:22.579575 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.579526 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-gzjxz" podStartSLOduration=13.53140615 podStartE2EDuration="24.579509128s" totalImagesPullingTime="11.048102978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.578563936 +0000 UTC m=+93.295902177" watchObservedRunningTime="2026-07-11 03:44:22.579509128 +0000 UTC m=+93.296847366" Jul 11 03:44:22.593902 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.593862 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-mx7rk" podStartSLOduration=12.317510848 podStartE2EDuration="24.593830598s" totalImagesPullingTime="12.27631975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.592882949 +0000 UTC m=+93.310221185" watchObservedRunningTime="2026-07-11 03:44:22.593830598 +0000 UTC m=+93.311168885" Jul 11 03:44:22.616025 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.613344 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9f986458-8qnlh" podStartSLOduration=12.217204406 podStartE2EDuration="24.613326999s" totalImagesPullingTime="12.396122593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.612110149 +0000 UTC m=+93.329448386" watchObservedRunningTime="2026-07-11 03:44:22.613326999 +0000 UTC m=+93.330665237" Jul 11 03:44:22.641127 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.641082 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c99ccc7fd-dk5sm" podStartSLOduration=3.36173541 podStartE2EDuration="15.64106727s" totalImagesPullingTime="12.27933186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.64055123 +0000 UTC m=+93.357889468" watchObservedRunningTime="2026-07-11 03:44:22.64106727 +0000 UTC m=+93.358405504" Jul 11 03:44:22.662071 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:22.662018 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ptkxg" podStartSLOduration=13.732330197 podStartE2EDuration="24.661999818s" totalImagesPullingTime="10.857310221s" totalInitContainerRuntime="72.3594ms" isStatefulPod=true podCreationTimestamp="2026-07-11 03:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:22.661076224 +0000 UTC m=+93.378414461" watchObservedRunningTime="2026-07-11 03:44:22.661999818 +0000 UTC m=+93.379338382" Jul 11 03:44:23.442974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:23.442874 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9f986458-8qnlh"] Jul 11 03:44:24.559603 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:24.559524 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"d530175fc6b8f982e87355a68e3f6cbc8a42fdcb5cc288f7b2dbde9ed7666078"} Jul 11 03:44:24.560055 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:24.559617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"772b817eb4f4b9b00a5721e8a0c5be613c497bcd581bd72916594d017c6da4b2"} Jul 11 03:44:24.561382 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:24.561354 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgt5h" event={"ID":"9ac9160c-8272-496c-a725-28ac80d68d97","Type":"ContainerStarted","Data":"e147c10da014ff1563947c2ff8d9002d79e35b45dfa5e8ee2d12013bc1016934"} Jul 11 03:44:25.573915 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.573875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"286d6040153c973c4067a6e8dc46e32a1836e0a9e4b7eba23421db216e0b9bc7"} Jul 11 03:44:25.574407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.574006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"0091aa1212983523181bdc379416dcaefe153fb8916cb9580e62115266af96da"} Jul 11 03:44:25.574407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.574100 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"a388140849717ba93236355d80f2e6c870d5c23f8a1c779e193e2f8bbddbf345"} Jul 11 03:44:25.574407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.574144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"97b0ffde18d1c541f9f5e1f839b42feea93c6a97f376da654dee5d922792ef3c"} Jul 11 03:44:25.574407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.574188 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"e24ca26d912a6ed99101efc6ab65b4cb405c60094d33e9d2c21bd0013bb35561"} Jul 11 03:44:25.574407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.574226 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerStarted","Data":"e1e2e0c70c0f6d76034a1d34eee8c89dc2f510fc77ce5882663a5dbb10f66fe4"} Jul 11 03:44:25.578169 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.578143 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" event={"ID":"7c8d98b1-e5cf-42a3-a07d-61b875fafac3","Type":"ContainerStarted","Data":"52e707853e2509e961cacc77273512ad318b85137d5e54870f9c31714ab275c7"} Jul 11 03:44:25.578318 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.578296 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:25.599805 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.599671 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=13.388362082 podStartE2EDuration="26.599650932s" totalImagesPullingTime="13.189375513s" totalInitContainerRuntime="21.913337ms" isStatefulPod=false podCreationTimestamp="2026-07-11 03:43:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:25.596894401 +0000 UTC m=+96.314232639" watchObservedRunningTime="2026-07-11 03:44:25.599650932 +0000 UTC m=+96.316989173" Jul 11 03:44:25.618530 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:25.617941 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" podStartSLOduration=11.21949925 podStartE2EDuration="25.617924202s" totalImagesPullingTime="14.398424952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:44:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:25.617763925 +0000 UTC m=+96.335102162" watchObservedRunningTime="2026-07-11 03:44:25.617924202 +0000 UTC m=+96.335262445" Jul 11 03:44:27.427855 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:27.427818 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:27.428260 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:27.427896 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:27.432869 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:27.432826 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:27.589473 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:27.589430 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tgt5h" event={"ID":"9ac9160c-8272-496c-a725-28ac80d68d97","Type":"ContainerStarted","Data":"ee75ae546032e3cf0213cd6043d66e28716a0eeb29db11ba5dbdb297afdac696"} Jul 11 03:44:27.593448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:27.593426 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:44:27.605770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:27.605716 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tgt5h" podStartSLOduration=20.963580444 podStartE2EDuration="38.605679846s" totalImagesPullingTime="17.642099402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 03:43:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:44:27.604474187 +0000 UTC m=+98.321812426" watchObservedRunningTime="2026-07-11 03:44:27.605679846 +0000 UTC m=+98.323018083" Jul 11 03:44:29.074704 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:29.074668 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:44:31.586980 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:31.586953 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-546566c6bb-w4bzr" Jul 11 03:44:34.301499 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:34.301467 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c99ccc7fd-dk5sm"] Jul 11 03:44:40.464046 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:40.464013 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2wlt" Jul 11 03:44:49.583332 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.583273 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f9f986458-8qnlh" podUID="efb7cf29-1c62-48da-951b-39a9f9623619" containerName="console" containerID="cri-o://e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7" gracePeriod=15 Jul 11 03:44:49.873211 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.873172 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:44:49.964141 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964109 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-console-config\") pod \"efb7cf29-1c62-48da-951b-39a9f9623619\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " Jul 11 03:44:49.964379 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964148 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-service-ca\") pod \"efb7cf29-1c62-48da-951b-39a9f9623619\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " Jul 11 03:44:49.964379 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964182 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-serving-cert\") pod \"efb7cf29-1c62-48da-951b-39a9f9623619\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " Jul 11 03:44:49.964379 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964256 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-oauth-config\") pod \"efb7cf29-1c62-48da-951b-39a9f9623619\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " Jul 11 03:44:49.964379 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964292 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8m5p\" (UniqueName: \"kubernetes.io/projected/efb7cf29-1c62-48da-951b-39a9f9623619-kube-api-access-w8m5p\") pod \"efb7cf29-1c62-48da-951b-39a9f9623619\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " Jul 11 03:44:49.964379 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964324 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-oauth-serving-cert\") pod \"efb7cf29-1c62-48da-951b-39a9f9623619\" (UID: \"efb7cf29-1c62-48da-951b-39a9f9623619\") " Jul 11 03:44:49.964651 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964556 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-console-config" (OuterVolumeSpecName: "console-config") pod "efb7cf29-1c62-48da-951b-39a9f9623619" (UID: "efb7cf29-1c62-48da-951b-39a9f9623619"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:44:49.964651 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964560 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-service-ca" (OuterVolumeSpecName: "service-ca") pod "efb7cf29-1c62-48da-951b-39a9f9623619" (UID: "efb7cf29-1c62-48da-951b-39a9f9623619"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:44:49.964924 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.964895 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efb7cf29-1c62-48da-951b-39a9f9623619" (UID: "efb7cf29-1c62-48da-951b-39a9f9623619"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:44:49.966790 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.966761 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb7cf29-1c62-48da-951b-39a9f9623619-kube-api-access-w8m5p" (OuterVolumeSpecName: "kube-api-access-w8m5p") pod "efb7cf29-1c62-48da-951b-39a9f9623619" (UID: "efb7cf29-1c62-48da-951b-39a9f9623619"). InnerVolumeSpecName "kube-api-access-w8m5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:44:49.966932 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.966785 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efb7cf29-1c62-48da-951b-39a9f9623619" (UID: "efb7cf29-1c62-48da-951b-39a9f9623619"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:44:49.966932 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:49.966917 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efb7cf29-1c62-48da-951b-39a9f9623619" (UID: "efb7cf29-1c62-48da-951b-39a9f9623619"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:44:50.065772 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.065733 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-oauth-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:44:50.065772 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.065766 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8m5p\" (UniqueName: \"kubernetes.io/projected/efb7cf29-1c62-48da-951b-39a9f9623619-kube-api-access-w8m5p\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:44:50.065772 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.065776 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-oauth-serving-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:44:50.065772 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.065784 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-console-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:44:50.066052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.065793 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efb7cf29-1c62-48da-951b-39a9f9623619-service-ca\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:44:50.066052 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.065800 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efb7cf29-1c62-48da-951b-39a9f9623619-console-serving-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:44:50.691073 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.691035 2572 generic.go:356] "Generic (PLEG): container finished" podID="efb7cf29-1c62-48da-951b-39a9f9623619" containerID="e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7" exitCode=0 Jul 11 03:44:50.691073 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.691075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9f986458-8qnlh" event={"ID":"efb7cf29-1c62-48da-951b-39a9f9623619","Type":"ContainerDied","Data":"e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7"} Jul 11 03:44:50.691584 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.691103 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9f986458-8qnlh" Jul 11 03:44:50.691584 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.691160 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9f986458-8qnlh" event={"ID":"efb7cf29-1c62-48da-951b-39a9f9623619","Type":"ContainerDied","Data":"82e5b01c5550270c68b948aaeae8258a84409c20cc2ba30fcd5e4a3e2ee6b3ea"} Jul 11 03:44:50.691584 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.691203 2572 scope.go:117] "RemoveContainer" containerID="e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7" Jul 11 03:44:50.704933 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.704914 2572 scope.go:117] "RemoveContainer" containerID="e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7" Jul 11 03:44:50.705213 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:44:50.705195 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7\": container with ID starting with e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7 not found: ID does not exist" containerID="e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7" Jul 11 03:44:50.705274 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.705221 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7"} err="failed to get container status \"e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7\": rpc error: code = NotFound desc = could not find container \"e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7\": container with ID starting with e021decd70bb5aafd7614a7c69f821057e05e483f2c8828cfb73c9be760064a7 not found: ID does not exist" Jul 11 03:44:50.710644 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.710622 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9f986458-8qnlh"] Jul 11 03:44:50.716468 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:50.716444 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f9f986458-8qnlh"] Jul 11 03:44:51.834914 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:51.834879 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb7cf29-1c62-48da-951b-39a9f9623619" path="/var/lib/kubelet/pods/efb7cf29-1c62-48da-951b-39a9f9623619/volumes" Jul 11 03:44:59.322520 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:59.322452 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c99ccc7fd-dk5sm" podUID="4e6ec33f-3f8e-4392-b891-19e76f6886f3" containerName="console" containerID="cri-o://eebe7251d3a306801195bbebd87c61184998807dc47f075b6b5a7c4abf266343" gracePeriod=15 Jul 11 03:44:59.729262 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:59.729228 2572 generic.go:356] "Generic (PLEG): container finished" podID="4e6ec33f-3f8e-4392-b891-19e76f6886f3" containerID="eebe7251d3a306801195bbebd87c61184998807dc47f075b6b5a7c4abf266343" exitCode=0 Jul 11 03:44:59.729262 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:44:59.729264 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c99ccc7fd-dk5sm" event={"ID":"4e6ec33f-3f8e-4392-b891-19e76f6886f3","Type":"ContainerDied","Data":"eebe7251d3a306801195bbebd87c61184998807dc47f075b6b5a7c4abf266343"} Jul 11 03:45:00.096743 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.096707 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:45:00.146923 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.146877 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-serving-cert\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147116 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.146944 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qdts\" (UniqueName: \"kubernetes.io/projected/4e6ec33f-3f8e-4392-b891-19e76f6886f3-kube-api-access-2qdts\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147116 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.146966 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-trusted-ca-bundle\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147116 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147012 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-oauth-config\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147116 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147054 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-service-ca\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147116 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147089 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-config\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147116 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147115 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-oauth-serving-cert\") pod \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\" (UID: \"4e6ec33f-3f8e-4392-b891-19e76f6886f3\") " Jul 11 03:45:00.147592 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147558 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:45:00.147713 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147604 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:45:00.147713 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147664 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-config" (OuterVolumeSpecName: "console-config") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:45:00.147713 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.147700 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:45:00.149360 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.149338 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:00.149465 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.149426 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:00.149572 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.149550 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6ec33f-3f8e-4392-b891-19e76f6886f3-kube-api-access-2qdts" (OuterVolumeSpecName: "kube-api-access-2qdts") pod "4e6ec33f-3f8e-4392-b891-19e76f6886f3" (UID: "4e6ec33f-3f8e-4392-b891-19e76f6886f3"). InnerVolumeSpecName "kube-api-access-2qdts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248166 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-oauth-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248206 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-service-ca\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248219 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248230 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-oauth-serving-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248242 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ec33f-3f8e-4392-b891-19e76f6886f3-console-serving-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248254 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qdts\" (UniqueName: \"kubernetes.io/projected/4e6ec33f-3f8e-4392-b891-19e76f6886f3-kube-api-access-2qdts\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.248268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.248267 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ec33f-3f8e-4392-b891-19e76f6886f3-trusted-ca-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:00.734462 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.734437 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c99ccc7fd-dk5sm" Jul 11 03:45:00.734462 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.734449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c99ccc7fd-dk5sm" event={"ID":"4e6ec33f-3f8e-4392-b891-19e76f6886f3","Type":"ContainerDied","Data":"1eb3c8f517c945462851b4332fc82720ccb368fb2f1f9611eb98ed141eb475aa"} Jul 11 03:45:00.734995 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.734530 2572 scope.go:117] "RemoveContainer" containerID="eebe7251d3a306801195bbebd87c61184998807dc47f075b6b5a7c4abf266343" Jul 11 03:45:00.753989 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.753957 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c99ccc7fd-dk5sm"] Jul 11 03:45:00.757378 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:00.757354 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c99ccc7fd-dk5sm"] Jul 11 03:45:01.834656 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:01.834620 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6ec33f-3f8e-4392-b891-19e76f6886f3" path="/var/lib/kubelet/pods/4e6ec33f-3f8e-4392-b891-19e76f6886f3/volumes" Jul 11 03:45:18.519009 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.518977 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:45:18.519491 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.519261 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="alertmanager" containerID="cri-o://e1e2e0c70c0f6d76034a1d34eee8c89dc2f510fc77ce5882663a5dbb10f66fe4" gracePeriod=120 Jul 11 03:45:18.519491 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.519330 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-metric" containerID="cri-o://0091aa1212983523181bdc379416dcaefe153fb8916cb9580e62115266af96da" gracePeriod=120 Jul 11 03:45:18.519491 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.519350 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-web" containerID="cri-o://97b0ffde18d1c541f9f5e1f839b42feea93c6a97f376da654dee5d922792ef3c" gracePeriod=120 Jul 11 03:45:18.520254 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.520183 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="config-reloader" containerID="cri-o://e24ca26d912a6ed99101efc6ab65b4cb405c60094d33e9d2c21bd0013bb35561" gracePeriod=120 Jul 11 03:45:18.520364 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.520292 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="prom-label-proxy" containerID="cri-o://286d6040153c973c4067a6e8dc46e32a1836e0a9e4b7eba23421db216e0b9bc7" gracePeriod=120 Jul 11 03:45:18.520504 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.520426 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy" containerID="cri-o://a388140849717ba93236355d80f2e6c870d5c23f8a1c779e193e2f8bbddbf345" gracePeriod=120 Jul 11 03:45:18.809307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809215 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="286d6040153c973c4067a6e8dc46e32a1836e0a9e4b7eba23421db216e0b9bc7" exitCode=0 Jul 11 03:45:18.809307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809239 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="0091aa1212983523181bdc379416dcaefe153fb8916cb9580e62115266af96da" exitCode=0 Jul 11 03:45:18.809307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809246 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="a388140849717ba93236355d80f2e6c870d5c23f8a1c779e193e2f8bbddbf345" exitCode=0 Jul 11 03:45:18.809307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809252 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="e24ca26d912a6ed99101efc6ab65b4cb405c60094d33e9d2c21bd0013bb35561" exitCode=0 Jul 11 03:45:18.809307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809260 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="e1e2e0c70c0f6d76034a1d34eee8c89dc2f510fc77ce5882663a5dbb10f66fe4" exitCode=0 Jul 11 03:45:18.809307 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"286d6040153c973c4067a6e8dc46e32a1836e0a9e4b7eba23421db216e0b9bc7"} Jul 11 03:45:18.809583 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809369 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"0091aa1212983523181bdc379416dcaefe153fb8916cb9580e62115266af96da"} Jul 11 03:45:18.809583 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809397 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"a388140849717ba93236355d80f2e6c870d5c23f8a1c779e193e2f8bbddbf345"} Jul 11 03:45:18.809583 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"e24ca26d912a6ed99101efc6ab65b4cb405c60094d33e9d2c21bd0013bb35561"} Jul 11 03:45:18.809583 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:18.809443 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"e1e2e0c70c0f6d76034a1d34eee8c89dc2f510fc77ce5882663a5dbb10f66fe4"} Jul 11 03:45:19.817543 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.817509 2572 generic.go:356] "Generic (PLEG): container finished" podID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerID="97b0ffde18d1c541f9f5e1f839b42feea93c6a97f376da654dee5d922792ef3c" exitCode=0 Jul 11 03:45:19.817943 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.817585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"97b0ffde18d1c541f9f5e1f839b42feea93c6a97f376da654dee5d922792ef3c"} Jul 11 03:45:19.859577 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.859553 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:19.921699 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921617 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-volume\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921699 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921650 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921699 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921680 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-cluster-tls-config\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921715 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921742 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqpsm\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-kube-api-access-zqpsm\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921806 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-out\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921866 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-web-config\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921900 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921951 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-main-db\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.921990 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.921985 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.922559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.922014 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-tls-assets\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.922559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.922052 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-metrics-client-ca\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.922559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.922094 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"63fece06-d21c-47ad-856b-3e05e42ab7b3\" (UID: \"63fece06-d21c-47ad-856b-3e05e42ab7b3\") " Jul 11 03:45:19.922559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.922095 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:45:19.922559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.922404 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:45:19.922559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.922499 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:19.923452 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.923421 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:45:19.925781 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.925751 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:45:19.926381 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.926356 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:19.926644 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.926604 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-out" (OuterVolumeSpecName: "config-out") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:45:19.926746 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.926690 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-volume" (OuterVolumeSpecName: "config-volume") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:19.926861 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.926814 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-kube-api-access-zqpsm" (OuterVolumeSpecName: "kube-api-access-zqpsm") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "kube-api-access-zqpsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:45:19.927026 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.927004 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:19.927088 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.927036 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:19.927939 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.927915 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:19.930741 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.930608 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:19.937764 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:19.937737 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-web-config" (OuterVolumeSpecName: "web-config") pod "63fece06-d21c-47ad-856b-3e05e42ab7b3" (UID: "63fece06-d21c-47ad-856b-3e05e42ab7b3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:45:20.023549 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023517 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqpsm\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-kube-api-access-zqpsm\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023549 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023548 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-out\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023549 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023558 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-web-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023567 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023577 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63fece06-d21c-47ad-856b-3e05e42ab7b3-alertmanager-main-db\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023586 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023595 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63fece06-d21c-47ad-856b-3e05e42ab7b3-tls-assets\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023605 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63fece06-d21c-47ad-856b-3e05e42ab7b3-metrics-client-ca\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023613 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023621 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-config-volume\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023629 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-cluster-tls-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.023770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.023638 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63fece06-d21c-47ad-856b-3e05e42ab7b3-secret-alertmanager-main-tls\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:45:20.824151 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.824123 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:20.824518 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.824119 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63fece06-d21c-47ad-856b-3e05e42ab7b3","Type":"ContainerDied","Data":"47c6ee8b3c9d1002232fa812190fbe548ccf4feb6dc23f701ba2a77712c97677"} Jul 11 03:45:20.824518 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.824310 2572 scope.go:117] "RemoveContainer" containerID="286d6040153c973c4067a6e8dc46e32a1836e0a9e4b7eba23421db216e0b9bc7" Jul 11 03:45:20.832448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.832432 2572 scope.go:117] "RemoveContainer" containerID="0091aa1212983523181bdc379416dcaefe153fb8916cb9580e62115266af96da" Jul 11 03:45:20.839701 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.839680 2572 scope.go:117] "RemoveContainer" containerID="a388140849717ba93236355d80f2e6c870d5c23f8a1c779e193e2f8bbddbf345" Jul 11 03:45:20.846917 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.846893 2572 scope.go:117] "RemoveContainer" containerID="97b0ffde18d1c541f9f5e1f839b42feea93c6a97f376da654dee5d922792ef3c" Jul 11 03:45:20.848764 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.848746 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:45:20.853009 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.852986 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:45:20.854884 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.854821 2572 scope.go:117] "RemoveContainer" containerID="e24ca26d912a6ed99101efc6ab65b4cb405c60094d33e9d2c21bd0013bb35561" Jul 11 03:45:20.861519 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.861502 2572 scope.go:117] "RemoveContainer" containerID="e1e2e0c70c0f6d76034a1d34eee8c89dc2f510fc77ce5882663a5dbb10f66fe4" Jul 11 03:45:20.868508 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.868489 2572 scope.go:117] "RemoveContainer" containerID="6ce53fab66fe735476b1b9a394d734ae66bfa19427143f91d6dc304761073f76" Jul 11 03:45:20.876958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.876938 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:45:20.877257 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877245 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy" Jul 11 03:45:20.877297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877259 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy" Jul 11 03:45:20.877297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877267 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="config-reloader" Jul 11 03:45:20.877297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877272 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="config-reloader" Jul 11 03:45:20.877297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877279 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="prom-label-proxy" Jul 11 03:45:20.877297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877285 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="prom-label-proxy" Jul 11 03:45:20.877297 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877296 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6ec33f-3f8e-4392-b891-19e76f6886f3" containerName="console" Jul 11 03:45:20.877469 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877302 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6ec33f-3f8e-4392-b891-19e76f6886f3" containerName="console" Jul 11 03:45:20.877469 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877309 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="alertmanager" Jul 11 03:45:20.877469 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877319 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="alertmanager" Jul 11 03:45:20.877469 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877327 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="init-config-reloader" Jul 11 03:45:20.877469 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.877332 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="init-config-reloader" Jul 11 03:45:20.882407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882346 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-metric" Jul 11 03:45:20.882538 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882425 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-metric" Jul 11 03:45:20.882688 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882676 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-web" Jul 11 03:45:20.882744 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882690 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-web" Jul 11 03:45:20.882744 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882702 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb7cf29-1c62-48da-951b-39a9f9623619" containerName="console" Jul 11 03:45:20.882744 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882710 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb7cf29-1c62-48da-951b-39a9f9623619" containerName="console" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882806 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-web" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882821 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="alertmanager" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882831 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb7cf29-1c62-48da-951b-39a9f9623619" containerName="console" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882864 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="prom-label-proxy" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882875 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e6ec33f-3f8e-4392-b891-19e76f6886f3" containerName="console" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882886 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="config-reloader" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882895 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy-metric" Jul 11 03:45:20.882931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.882905 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" containerName="kube-rbac-proxy" Jul 11 03:45:20.886400 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.886380 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:20.888547 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888526 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 11 03:45:20.888655 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6nclt\"" Jul 11 03:45:20.888731 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 11 03:45:20.888731 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 11 03:45:20.888830 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 11 03:45:20.888830 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888811 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 11 03:45:20.888987 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.888971 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 11 03:45:20.889057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.889035 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 11 03:45:20.889241 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.889225 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 11 03:45:20.894341 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.894010 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 11 03:45:20.894557 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:20.894537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:45:21.031946 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.031906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb334c35-5518-46e7-8ef6-9727d43298db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.031946 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.031949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hx9\" (UniqueName: \"kubernetes.io/projected/eb334c35-5518-46e7-8ef6-9727d43298db-kube-api-access-g2hx9\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.031977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb334c35-5518-46e7-8ef6-9727d43298db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032039 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-web-config\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb334c35-5518-46e7-8ef6-9727d43298db-config-out\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032114 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032344 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032159 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032344 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032344 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb334c35-5518-46e7-8ef6-9727d43298db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032344 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb334c35-5518-46e7-8ef6-9727d43298db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032344 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.032501 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.032350 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133493 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133493 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133446 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133493 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb334c35-5518-46e7-8ef6-9727d43298db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb334c35-5518-46e7-8ef6-9727d43298db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133525 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb334c35-5518-46e7-8ef6-9727d43298db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hx9\" (UniqueName: \"kubernetes.io/projected/eb334c35-5518-46e7-8ef6-9727d43298db-kube-api-access-g2hx9\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133677 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb334c35-5518-46e7-8ef6-9727d43298db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.133720 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133719 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-web-config\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.134137 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb334c35-5518-46e7-8ef6-9727d43298db-config-out\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.134137 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.134137 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.133974 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/eb334c35-5518-46e7-8ef6-9727d43298db-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.134808 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.134677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb334c35-5518-46e7-8ef6-9727d43298db-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137314 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.136870 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-config-volume\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137314 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.136872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137314 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.136950 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb334c35-5518-46e7-8ef6-9727d43298db-tls-assets\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137314 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.137071 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137314 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.137272 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-web-config\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137314 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.137298 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137558 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.137473 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137558 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.137542 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/eb334c35-5518-46e7-8ef6-9727d43298db-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.137699 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.137676 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb334c35-5518-46e7-8ef6-9727d43298db-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.138785 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.138764 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb334c35-5518-46e7-8ef6-9727d43298db-config-out\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.145138 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.145112 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hx9\" (UniqueName: \"kubernetes.io/projected/eb334c35-5518-46e7-8ef6-9727d43298db-kube-api-access-g2hx9\") pod \"alertmanager-main-0\" (UID: \"eb334c35-5518-46e7-8ef6-9727d43298db\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.197269 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.197235 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 03:45:21.332416 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.332379 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 03:45:21.337384 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:45:21.337356 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb334c35_5518_46e7_8ef6_9727d43298db.slice/crio-f36d1eae645f73a7ea3e6623f019a60863713a2c3cc89cc1c077b206f11902da WatchSource:0}: Error finding container f36d1eae645f73a7ea3e6623f019a60863713a2c3cc89cc1c077b206f11902da: Status 404 returned error can't find the container with id f36d1eae645f73a7ea3e6623f019a60863713a2c3cc89cc1c077b206f11902da Jul 11 03:45:21.828968 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.828882 2572 generic.go:356] "Generic (PLEG): container finished" podID="eb334c35-5518-46e7-8ef6-9727d43298db" containerID="ee0064fe090a6b9bf38325b3a4b0b7617034f6c5dcebaa71181af3708df89046" exitCode=0 Jul 11 03:45:21.829384 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.828975 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerDied","Data":"ee0064fe090a6b9bf38325b3a4b0b7617034f6c5dcebaa71181af3708df89046"} Jul 11 03:45:21.829384 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.829044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"f36d1eae645f73a7ea3e6623f019a60863713a2c3cc89cc1c077b206f11902da"} Jul 11 03:45:21.834403 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:21.834380 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63fece06-d21c-47ad-856b-3e05e42ab7b3" path="/var/lib/kubelet/pods/63fece06-d21c-47ad-856b-3e05e42ab7b3/volumes" Jul 11 03:45:22.838113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.838071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"dd57adb3f03989fc9711039e169c3b58c3412f6802d4f81cfbeecfd9bd0bac77"} Jul 11 03:45:22.838626 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.838169 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"444ec205c00070cfec6455cdb705f08fd2a86cdd654d2fa26a5e53963277e536"} Jul 11 03:45:22.838626 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.838199 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"ea649b20536812341be0c96f957084fc697fe242045a232c477f8ef70aabd490"} Jul 11 03:45:22.838626 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.838227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"030e9214ef0ca66caa4a835902ce47c75cb6515046c3d58c4416c77a18b1921f"} Jul 11 03:45:22.838626 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.838262 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"90864846b397a81c571e617972b6df427e7261275bf765b6d9a8737a70812846"} Jul 11 03:45:22.838626 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.838298 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"eb334c35-5518-46e7-8ef6-9727d43298db","Type":"ContainerStarted","Data":"987658fb98a8c1c84816a40e761a9e819623622169b6d3ef0342eb5df23f72f0"} Jul 11 03:45:22.863975 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:22.863909 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.848610708 podStartE2EDuration="2.863887558s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.27685ms" isStatefulPod=false podCreationTimestamp="2026-07-11 03:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:45:22.861213197 +0000 UTC m=+153.578551424" watchObservedRunningTime="2026-07-11 03:45:22.863887558 +0000 UTC m=+153.581225795" Jul 11 03:45:39.655503 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.655469 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664d45d96b-jnjt6"] Jul 11 03:45:39.658639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.658618 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.661810 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.661585 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6nww6\"" Jul 11 03:45:39.661810 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.661608 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 11 03:45:39.661810 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.661643 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 11 03:45:39.661810 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.661651 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 11 03:45:39.661810 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.661688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 11 03:45:39.661810 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.661695 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 11 03:45:39.666094 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.666071 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 11 03:45:39.671409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.671387 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d45d96b-jnjt6"] Jul 11 03:45:39.790063 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-config\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.790268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-service-ca\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.790268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jk88\" (UniqueName: \"kubernetes.io/projected/d74eaa60-c56e-4eec-9ac8-25e8b064332f-kube-api-access-7jk88\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.790268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-oauth-config\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.790268 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-oauth-serving-cert\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.790424 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-serving-cert\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.790424 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.790343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-trusted-ca-bundle\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.890760 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-service-ca\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.890760 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jk88\" (UniqueName: \"kubernetes.io/projected/d74eaa60-c56e-4eec-9ac8-25e8b064332f-kube-api-access-7jk88\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891013 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-oauth-config\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891013 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-oauth-serving-cert\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891013 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-serving-cert\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891013 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-trusted-ca-bundle\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891013 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.890982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-config\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891521 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.891496 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-service-ca\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891635 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.891614 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-config\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.891687 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.891614 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-oauth-serving-cert\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.892119 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.892098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-trusted-ca-bundle\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.893504 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.893488 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-serving-cert\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.893556 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.893511 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-oauth-config\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.898723 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.898701 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jk88\" (UniqueName: \"kubernetes.io/projected/d74eaa60-c56e-4eec-9ac8-25e8b064332f-kube-api-access-7jk88\") pod \"console-664d45d96b-jnjt6\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:39.970832 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:39.970741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:40.101657 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:40.101634 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d45d96b-jnjt6"] Jul 11 03:45:40.104263 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:45:40.104215 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74eaa60_c56e_4eec_9ac8_25e8b064332f.slice/crio-a12e6955a7be72ae9df54087cf6ef124205cdd61748b2136c16f8cbcbdfd6fc8 WatchSource:0}: Error finding container a12e6955a7be72ae9df54087cf6ef124205cdd61748b2136c16f8cbcbdfd6fc8: Status 404 returned error can't find the container with id a12e6955a7be72ae9df54087cf6ef124205cdd61748b2136c16f8cbcbdfd6fc8 Jul 11 03:45:40.911585 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:40.911508 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d45d96b-jnjt6" event={"ID":"d74eaa60-c56e-4eec-9ac8-25e8b064332f","Type":"ContainerStarted","Data":"bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e"} Jul 11 03:45:40.911585 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:40.911555 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d45d96b-jnjt6" event={"ID":"d74eaa60-c56e-4eec-9ac8-25e8b064332f","Type":"ContainerStarted","Data":"a12e6955a7be72ae9df54087cf6ef124205cdd61748b2136c16f8cbcbdfd6fc8"} Jul 11 03:45:40.929352 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:40.929288 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664d45d96b-jnjt6" podStartSLOduration=1.929273211 podStartE2EDuration="1.929273211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:45:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:45:40.928023573 +0000 UTC m=+171.645361809" watchObservedRunningTime="2026-07-11 03:45:40.929273211 +0000 UTC m=+171.646611448" Jul 11 03:45:49.971627 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:49.971527 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:49.971627 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:49.971612 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:49.976535 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:49.976514 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:45:50.954793 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:45:50.954765 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:46:10.456453 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.456417 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t"] Jul 11 03:46:10.459927 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.459906 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.462264 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.462243 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 11 03:46:10.462992 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.462973 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dxg8w\"" Jul 11 03:46:10.463076 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.462990 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 11 03:46:10.468504 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.468484 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t"] Jul 11 03:46:10.560943 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.560907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.561127 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.560967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.561127 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.561057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mndkn\" (UniqueName: \"kubernetes.io/projected/524572f9-fa35-430b-9970-1be0860c8757-kube-api-access-mndkn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.662425 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.662391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.662539 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.662438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.662596 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.662574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mndkn\" (UniqueName: \"kubernetes.io/projected/524572f9-fa35-430b-9970-1be0860c8757-kube-api-access-mndkn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.662765 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.662749 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.662799 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.662788 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.670671 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.670643 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mndkn\" (UniqueName: \"kubernetes.io/projected/524572f9-fa35-430b-9970-1be0860c8757-kube-api-access-mndkn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.769938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.769860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:10.898125 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:10.898092 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t"] Jul 11 03:46:10.900995 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:46:10.900959 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524572f9_fa35_430b_9970_1be0860c8757.slice/crio-2b2f08363109323f22bd80256a605788b815eae0a0a709ca19caca058c624be2 WatchSource:0}: Error finding container 2b2f08363109323f22bd80256a605788b815eae0a0a709ca19caca058c624be2: Status 404 returned error can't find the container with id 2b2f08363109323f22bd80256a605788b815eae0a0a709ca19caca058c624be2 Jul 11 03:46:11.027636 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:11.027544 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" event={"ID":"524572f9-fa35-430b-9970-1be0860c8757","Type":"ContainerStarted","Data":"2b2f08363109323f22bd80256a605788b815eae0a0a709ca19caca058c624be2"} Jul 11 03:46:17.056263 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:17.056173 2572 generic.go:356] "Generic (PLEG): container finished" podID="524572f9-fa35-430b-9970-1be0860c8757" containerID="366aecc33d2cbd2d39699966049f778ae30e6996d4902719122f0b7012e76985" exitCode=0 Jul 11 03:46:17.056618 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:17.056264 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" event={"ID":"524572f9-fa35-430b-9970-1be0860c8757","Type":"ContainerDied","Data":"366aecc33d2cbd2d39699966049f778ae30e6996d4902719122f0b7012e76985"} Jul 11 03:46:20.074260 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:20.074223 2572 generic.go:356] "Generic (PLEG): container finished" podID="524572f9-fa35-430b-9970-1be0860c8757" containerID="9775db674e07b5683bfb04443b47e67f76c5d31b00880e890a70a47d9fc5ac55" exitCode=0 Jul 11 03:46:20.074787 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:20.074273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" event={"ID":"524572f9-fa35-430b-9970-1be0860c8757","Type":"ContainerDied","Data":"9775db674e07b5683bfb04443b47e67f76c5d31b00880e890a70a47d9fc5ac55"} Jul 11 03:46:27.108667 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:27.108632 2572 generic.go:356] "Generic (PLEG): container finished" podID="524572f9-fa35-430b-9970-1be0860c8757" containerID="57bfcca89a9b902dc25bf813584706d08656bad7c21d815d6d9eb957b2ee66b2" exitCode=0 Jul 11 03:46:27.109077 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:27.108729 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" event={"ID":"524572f9-fa35-430b-9970-1be0860c8757","Type":"ContainerDied","Data":"57bfcca89a9b902dc25bf813584706d08656bad7c21d815d6d9eb957b2ee66b2"} Jul 11 03:46:28.248657 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.248635 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:28.317804 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.317769 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-util\") pod \"524572f9-fa35-430b-9970-1be0860c8757\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " Jul 11 03:46:28.318004 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.317834 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mndkn\" (UniqueName: \"kubernetes.io/projected/524572f9-fa35-430b-9970-1be0860c8757-kube-api-access-mndkn\") pod \"524572f9-fa35-430b-9970-1be0860c8757\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " Jul 11 03:46:28.318004 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.317879 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-bundle\") pod \"524572f9-fa35-430b-9970-1be0860c8757\" (UID: \"524572f9-fa35-430b-9970-1be0860c8757\") " Jul 11 03:46:28.318724 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.318680 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-bundle" (OuterVolumeSpecName: "bundle") pod "524572f9-fa35-430b-9970-1be0860c8757" (UID: "524572f9-fa35-430b-9970-1be0860c8757"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:46:28.320246 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.320221 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/524572f9-fa35-430b-9970-1be0860c8757-kube-api-access-mndkn" (OuterVolumeSpecName: "kube-api-access-mndkn") pod "524572f9-fa35-430b-9970-1be0860c8757" (UID: "524572f9-fa35-430b-9970-1be0860c8757"). InnerVolumeSpecName "kube-api-access-mndkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:46:28.322470 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.322449 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-util" (OuterVolumeSpecName: "util") pod "524572f9-fa35-430b-9970-1be0860c8757" (UID: "524572f9-fa35-430b-9970-1be0860c8757"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:46:28.419245 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.419165 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mndkn\" (UniqueName: \"kubernetes.io/projected/524572f9-fa35-430b-9970-1be0860c8757-kube-api-access-mndkn\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:46:28.419245 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.419191 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:46:28.419245 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:28.419201 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/524572f9-fa35-430b-9970-1be0860c8757-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:46:29.119107 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:29.119070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" event={"ID":"524572f9-fa35-430b-9970-1be0860c8757","Type":"ContainerDied","Data":"2b2f08363109323f22bd80256a605788b815eae0a0a709ca19caca058c624be2"} Jul 11 03:46:29.119267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:29.119121 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b2f08363109323f22bd80256a605788b815eae0a0a709ca19caca058c624be2" Jul 11 03:46:29.119267 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:29.119089 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nls5t" Jul 11 03:46:33.412376 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412343 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp"] Jul 11 03:46:33.412751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412653 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="extract" Jul 11 03:46:33.412751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412664 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="extract" Jul 11 03:46:33.412751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412679 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="util" Jul 11 03:46:33.412751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412685 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="util" Jul 11 03:46:33.412751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412701 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="pull" Jul 11 03:46:33.412751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412706 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="pull" Jul 11 03:46:33.412964 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.412785 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="524572f9-fa35-430b-9970-1be0860c8757" containerName="extract" Jul 11 03:46:33.414770 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.414755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.417053 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.417031 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6dwwr\"" Jul 11 03:46:33.417173 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.417035 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 11 03:46:33.417173 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.417165 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 11 03:46:33.427996 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.427974 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp"] Jul 11 03:46:33.459708 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.459672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbmzh\" (UniqueName: \"kubernetes.io/projected/a79bfd78-1f5c-42fa-aabc-c1025819cc9b-kube-api-access-fbmzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8clpp\" (UID: \"a79bfd78-1f5c-42fa-aabc-c1025819cc9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.459894 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.459713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79bfd78-1f5c-42fa-aabc-c1025819cc9b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8clpp\" (UID: \"a79bfd78-1f5c-42fa-aabc-c1025819cc9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.560606 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.560567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbmzh\" (UniqueName: \"kubernetes.io/projected/a79bfd78-1f5c-42fa-aabc-c1025819cc9b-kube-api-access-fbmzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8clpp\" (UID: \"a79bfd78-1f5c-42fa-aabc-c1025819cc9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.560764 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.560614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79bfd78-1f5c-42fa-aabc-c1025819cc9b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8clpp\" (UID: \"a79bfd78-1f5c-42fa-aabc-c1025819cc9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.560964 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.560949 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79bfd78-1f5c-42fa-aabc-c1025819cc9b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8clpp\" (UID: \"a79bfd78-1f5c-42fa-aabc-c1025819cc9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.570224 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.570199 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbmzh\" (UniqueName: \"kubernetes.io/projected/a79bfd78-1f5c-42fa-aabc-c1025819cc9b-kube-api-access-fbmzh\") pod \"cert-manager-operator-controller-manager-55c444bf86-8clpp\" (UID: \"a79bfd78-1f5c-42fa-aabc-c1025819cc9b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.723984 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.723901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" Jul 11 03:46:33.855229 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:33.855187 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp"] Jul 11 03:46:33.859585 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:46:33.859549 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79bfd78_1f5c_42fa_aabc_c1025819cc9b.slice/crio-0cd11132d1451dcdd45b98853cbc87c818f286991e08fcdc9b26cac506b84f56 WatchSource:0}: Error finding container 0cd11132d1451dcdd45b98853cbc87c818f286991e08fcdc9b26cac506b84f56: Status 404 returned error can't find the container with id 0cd11132d1451dcdd45b98853cbc87c818f286991e08fcdc9b26cac506b84f56 Jul 11 03:46:34.146642 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:34.146604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" event={"ID":"a79bfd78-1f5c-42fa-aabc-c1025819cc9b","Type":"ContainerStarted","Data":"0cd11132d1451dcdd45b98853cbc87c818f286991e08fcdc9b26cac506b84f56"} Jul 11 03:46:36.161750 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:36.161713 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" event={"ID":"a79bfd78-1f5c-42fa-aabc-c1025819cc9b","Type":"ContainerStarted","Data":"e2e0ccce6bf435358e1cade23a42ba6e267cc7fc08f154cafb8efbc6108aef57"} Jul 11 03:46:36.184651 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:36.184593 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8clpp" podStartSLOduration=1.229557604 podStartE2EDuration="3.184577898s" totalImagesPullingTime="1.955020294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:46:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:46:36.183092528 +0000 UTC m=+226.900430776" watchObservedRunningTime="2026-07-11 03:46:36.184577898 +0000 UTC m=+226.901916135" Jul 11 03:46:37.256262 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.256225 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw"] Jul 11 03:46:37.258782 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.258763 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.260926 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.260904 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 11 03:46:37.260926 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.260922 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 11 03:46:37.261087 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.260949 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dxg8w\"" Jul 11 03:46:37.268468 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.268443 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw"] Jul 11 03:46:37.298037 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.298006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.298183 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.298044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzll5\" (UniqueName: \"kubernetes.io/projected/6555867a-9703-42f0-8c6c-051b86bb4652-kube-api-access-jzll5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.298183 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.298085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.399111 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.399078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.399277 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.399119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzll5\" (UniqueName: \"kubernetes.io/projected/6555867a-9703-42f0-8c6c-051b86bb4652-kube-api-access-jzll5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.399277 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.399263 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.399482 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.399464 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.399599 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.399581 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.410178 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.410150 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzll5\" (UniqueName: \"kubernetes.io/projected/6555867a-9703-42f0-8c6c-051b86bb4652-kube-api-access-jzll5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.567909 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.567784 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:37.699986 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:37.699963 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw"] Jul 11 03:46:37.702113 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:46:37.702082 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6555867a_9703_42f0_8c6c_051b86bb4652.slice/crio-99a5c4cd91c6600005d8bdf61eb800c7a62cc2e1e9a7e71582d66cd2149d5d00 WatchSource:0}: Error finding container 99a5c4cd91c6600005d8bdf61eb800c7a62cc2e1e9a7e71582d66cd2149d5d00: Status 404 returned error can't find the container with id 99a5c4cd91c6600005d8bdf61eb800c7a62cc2e1e9a7e71582d66cd2149d5d00 Jul 11 03:46:38.173244 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:38.173207 2572 generic.go:356] "Generic (PLEG): container finished" podID="6555867a-9703-42f0-8c6c-051b86bb4652" containerID="bb68d9b0729734ff0e0575bb284a8a04d31d3d147baf5ddbfb0e2cafc3db8c6a" exitCode=0 Jul 11 03:46:38.173456 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:38.173258 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" event={"ID":"6555867a-9703-42f0-8c6c-051b86bb4652","Type":"ContainerDied","Data":"bb68d9b0729734ff0e0575bb284a8a04d31d3d147baf5ddbfb0e2cafc3db8c6a"} Jul 11 03:46:38.173456 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:38.173303 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" event={"ID":"6555867a-9703-42f0-8c6c-051b86bb4652","Type":"ContainerStarted","Data":"99a5c4cd91c6600005d8bdf61eb800c7a62cc2e1e9a7e71582d66cd2149d5d00"} Jul 11 03:46:39.863334 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.863304 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w"] Jul 11 03:46:39.866685 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.866668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:39.868864 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.868828 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lbwp4\"" Jul 11 03:46:39.868958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.868912 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 11 03:46:39.869762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.869745 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 11 03:46:39.875072 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.875050 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w"] Jul 11 03:46:39.923974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.923950 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0488abe-22ba-43ec-b496-a503478b4208-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8bk8w\" (UID: \"c0488abe-22ba-43ec-b496-a503478b4208\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:39.924094 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:39.923980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlld9\" (UniqueName: \"kubernetes.io/projected/c0488abe-22ba-43ec-b496-a503478b4208-kube-api-access-mlld9\") pod \"cert-manager-cainjector-559cdd8c87-8bk8w\" (UID: \"c0488abe-22ba-43ec-b496-a503478b4208\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:40.025099 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.025052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0488abe-22ba-43ec-b496-a503478b4208-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8bk8w\" (UID: \"c0488abe-22ba-43ec-b496-a503478b4208\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:40.025255 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.025111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlld9\" (UniqueName: \"kubernetes.io/projected/c0488abe-22ba-43ec-b496-a503478b4208-kube-api-access-mlld9\") pod \"cert-manager-cainjector-559cdd8c87-8bk8w\" (UID: \"c0488abe-22ba-43ec-b496-a503478b4208\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:40.032897 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.032869 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlld9\" (UniqueName: \"kubernetes.io/projected/c0488abe-22ba-43ec-b496-a503478b4208-kube-api-access-mlld9\") pod \"cert-manager-cainjector-559cdd8c87-8bk8w\" (UID: \"c0488abe-22ba-43ec-b496-a503478b4208\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:40.033105 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.033088 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0488abe-22ba-43ec-b496-a503478b4208-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8bk8w\" (UID: \"c0488abe-22ba-43ec-b496-a503478b4208\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:40.183305 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.183222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" Jul 11 03:46:40.185135 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.185106 2572 generic.go:356] "Generic (PLEG): container finished" podID="6555867a-9703-42f0-8c6c-051b86bb4652" containerID="6816c836738ed8d8829236cda7ba3f2afd1edf601a7e1b485779fcdc69b22a7b" exitCode=0 Jul 11 03:46:40.185242 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.185191 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" event={"ID":"6555867a-9703-42f0-8c6c-051b86bb4652","Type":"ContainerDied","Data":"6816c836738ed8d8829236cda7ba3f2afd1edf601a7e1b485779fcdc69b22a7b"} Jul 11 03:46:40.322919 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:40.322897 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w"] Jul 11 03:46:40.325764 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:46:40.325739 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0488abe_22ba_43ec_b496_a503478b4208.slice/crio-7b14495fc8e38d48d4ac48690ca1aaaa882e1d4997403e8c01a3f16d01275be8 WatchSource:0}: Error finding container 7b14495fc8e38d48d4ac48690ca1aaaa882e1d4997403e8c01a3f16d01275be8: Status 404 returned error can't find the container with id 7b14495fc8e38d48d4ac48690ca1aaaa882e1d4997403e8c01a3f16d01275be8 Jul 11 03:46:41.192361 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:41.192328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" event={"ID":"c0488abe-22ba-43ec-b496-a503478b4208","Type":"ContainerStarted","Data":"7b14495fc8e38d48d4ac48690ca1aaaa882e1d4997403e8c01a3f16d01275be8"} Jul 11 03:46:41.194925 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:41.194896 2572 generic.go:356] "Generic (PLEG): container finished" podID="6555867a-9703-42f0-8c6c-051b86bb4652" containerID="0dd8b6e8e1d6b05a3142559b81e603818a0af93ba9238dc75c3f10497b0e5621" exitCode=0 Jul 11 03:46:41.195048 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:41.194956 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" event={"ID":"6555867a-9703-42f0-8c6c-051b86bb4652","Type":"ContainerDied","Data":"0dd8b6e8e1d6b05a3142559b81e603818a0af93ba9238dc75c3f10497b0e5621"} Jul 11 03:46:42.778063 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.778039 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:42.851538 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.851516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzll5\" (UniqueName: \"kubernetes.io/projected/6555867a-9703-42f0-8c6c-051b86bb4652-kube-api-access-jzll5\") pod \"6555867a-9703-42f0-8c6c-051b86bb4652\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " Jul 11 03:46:42.851636 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.851606 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-util\") pod \"6555867a-9703-42f0-8c6c-051b86bb4652\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " Jul 11 03:46:42.851691 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.851649 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-bundle\") pod \"6555867a-9703-42f0-8c6c-051b86bb4652\" (UID: \"6555867a-9703-42f0-8c6c-051b86bb4652\") " Jul 11 03:46:42.852109 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.852018 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-bundle" (OuterVolumeSpecName: "bundle") pod "6555867a-9703-42f0-8c6c-051b86bb4652" (UID: "6555867a-9703-42f0-8c6c-051b86bb4652"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:46:42.853650 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.853627 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6555867a-9703-42f0-8c6c-051b86bb4652-kube-api-access-jzll5" (OuterVolumeSpecName: "kube-api-access-jzll5") pod "6555867a-9703-42f0-8c6c-051b86bb4652" (UID: "6555867a-9703-42f0-8c6c-051b86bb4652"). InnerVolumeSpecName "kube-api-access-jzll5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:46:42.859808 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.859780 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-util" (OuterVolumeSpecName: "util") pod "6555867a-9703-42f0-8c6c-051b86bb4652" (UID: "6555867a-9703-42f0-8c6c-051b86bb4652"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:46:42.953315 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.953271 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:46:42.953315 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.953307 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6555867a-9703-42f0-8c6c-051b86bb4652-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:46:42.953315 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:42.953322 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzll5\" (UniqueName: \"kubernetes.io/projected/6555867a-9703-42f0-8c6c-051b86bb4652-kube-api-access-jzll5\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:46:43.206874 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:43.206825 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" Jul 11 03:46:43.206874 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:43.206862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqrngw" event={"ID":"6555867a-9703-42f0-8c6c-051b86bb4652","Type":"ContainerDied","Data":"99a5c4cd91c6600005d8bdf61eb800c7a62cc2e1e9a7e71582d66cd2149d5d00"} Jul 11 03:46:43.207133 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:43.206916 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99a5c4cd91c6600005d8bdf61eb800c7a62cc2e1e9a7e71582d66cd2149d5d00" Jul 11 03:46:43.208548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:43.208522 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" event={"ID":"c0488abe-22ba-43ec-b496-a503478b4208","Type":"ContainerStarted","Data":"0408417d498fcbdfd88cd8b825891d024aff00a56bdff1ff5ed1b5de913ccd52"} Jul 11 03:46:43.225101 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:43.225056 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8bk8w" podStartSLOduration=1.7319829580000001 podStartE2EDuration="4.225039876s" totalImagesPullingTime="2.493056918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:46:43.223159964 +0000 UTC m=+233.940498202" watchObservedRunningTime="2026-07-11 03:46:43.225039876 +0000 UTC m=+233.942378112" Jul 11 03:46:50.055744 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.055712 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m"] Jul 11 03:46:50.056158 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056054 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="util" Jul 11 03:46:50.056158 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056065 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="util" Jul 11 03:46:50.056158 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056075 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="pull" Jul 11 03:46:50.056158 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056080 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="pull" Jul 11 03:46:50.056158 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056096 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="extract" Jul 11 03:46:50.056158 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056102 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="extract" Jul 11 03:46:50.056337 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.056179 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6555867a-9703-42f0-8c6c-051b86bb4652" containerName="extract" Jul 11 03:46:50.059299 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.059281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.061519 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.061493 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 11 03:46:50.061622 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.061531 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 11 03:46:50.062387 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.062357 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qnqzn\"" Jul 11 03:46:50.067769 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.067748 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m"] Jul 11 03:46:50.115481 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.115450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236789ff-ad04-4287-b426-84fb67fc53fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n4n6m\" (UID: \"236789ff-ad04-4287-b426-84fb67fc53fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.115674 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.115489 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv9kv\" (UniqueName: \"kubernetes.io/projected/236789ff-ad04-4287-b426-84fb67fc53fb-kube-api-access-xv9kv\") pod \"openshift-lws-operator-fd8ccff4c-n4n6m\" (UID: \"236789ff-ad04-4287-b426-84fb67fc53fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.216466 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.216425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236789ff-ad04-4287-b426-84fb67fc53fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n4n6m\" (UID: \"236789ff-ad04-4287-b426-84fb67fc53fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.216466 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.216468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv9kv\" (UniqueName: \"kubernetes.io/projected/236789ff-ad04-4287-b426-84fb67fc53fb-kube-api-access-xv9kv\") pod \"openshift-lws-operator-fd8ccff4c-n4n6m\" (UID: \"236789ff-ad04-4287-b426-84fb67fc53fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.216817 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.216798 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236789ff-ad04-4287-b426-84fb67fc53fb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-n4n6m\" (UID: \"236789ff-ad04-4287-b426-84fb67fc53fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.224603 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.224578 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv9kv\" (UniqueName: \"kubernetes.io/projected/236789ff-ad04-4287-b426-84fb67fc53fb-kube-api-access-xv9kv\") pod \"openshift-lws-operator-fd8ccff4c-n4n6m\" (UID: \"236789ff-ad04-4287-b426-84fb67fc53fb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.369224 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.369188 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" Jul 11 03:46:50.500381 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:50.500351 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m"] Jul 11 03:46:50.503217 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:46:50.503181 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod236789ff_ad04_4287_b426_84fb67fc53fb.slice/crio-7f56aa6fa11c5b0b507ea0e65c6f24257cdc08bae714fa489c733ad7b544a7e5 WatchSource:0}: Error finding container 7f56aa6fa11c5b0b507ea0e65c6f24257cdc08bae714fa489c733ad7b544a7e5: Status 404 returned error can't find the container with id 7f56aa6fa11c5b0b507ea0e65c6f24257cdc08bae714fa489c733ad7b544a7e5 Jul 11 03:46:51.256108 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:51.256069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" event={"ID":"236789ff-ad04-4287-b426-84fb67fc53fb","Type":"ContainerStarted","Data":"7f56aa6fa11c5b0b507ea0e65c6f24257cdc08bae714fa489c733ad7b544a7e5"} Jul 11 03:46:54.271730 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:54.271697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" event={"ID":"236789ff-ad04-4287-b426-84fb67fc53fb","Type":"ContainerStarted","Data":"7f7596adf1d14ca31f8160c2c204382d417d702c089fcddcfd91ccece496bf1b"} Jul 11 03:46:54.288325 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:54.288278 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-n4n6m" podStartSLOduration=1.000849804 podStartE2EDuration="4.288262812s" totalImagesPullingTime="3.287413008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:46:54.286783554 +0000 UTC m=+245.004121791" watchObservedRunningTime="2026-07-11 03:46:54.288262812 +0000 UTC m=+245.005601068" Jul 11 03:46:57.706766 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.706732 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb"] Jul 11 03:46:57.723998 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.723969 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb"] Jul 11 03:46:57.724156 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.724080 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.726596 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.726575 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 11 03:46:57.727299 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.727278 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 11 03:46:57.727428 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.727308 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dxg8w\"" Jul 11 03:46:57.885602 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.885564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.885867 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.885625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c29br\" (UniqueName: \"kubernetes.io/projected/29797cc5-be08-4971-9074-fa41090a841a-kube-api-access-c29br\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.885867 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.885715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.987148 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.987037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.987148 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.987094 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c29br\" (UniqueName: \"kubernetes.io/projected/29797cc5-be08-4971-9074-fa41090a841a-kube-api-access-c29br\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.987148 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.987143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.987500 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.987474 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.987577 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.987503 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:57.994659 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:57.994633 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c29br\" (UniqueName: \"kubernetes.io/projected/29797cc5-be08-4971-9074-fa41090a841a-kube-api-access-c29br\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:58.036738 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:58.036707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:46:58.184751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:58.184731 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb"] Jul 11 03:46:58.187110 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:46:58.187083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29797cc5_be08_4971_9074_fa41090a841a.slice/crio-0acdae041df4d7e1542f03a15331d47d844a7902722c411141c5fc6297be87dd WatchSource:0}: Error finding container 0acdae041df4d7e1542f03a15331d47d844a7902722c411141c5fc6297be87dd: Status 404 returned error can't find the container with id 0acdae041df4d7e1542f03a15331d47d844a7902722c411141c5fc6297be87dd Jul 11 03:46:58.294257 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:58.294232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" event={"ID":"29797cc5-be08-4971-9074-fa41090a841a","Type":"ContainerStarted","Data":"0acdae041df4d7e1542f03a15331d47d844a7902722c411141c5fc6297be87dd"} Jul 11 03:46:59.300641 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:59.300555 2572 generic.go:356] "Generic (PLEG): container finished" podID="29797cc5-be08-4971-9074-fa41090a841a" containerID="a9546689e0daaf3ff635600fd0568c0bde37ee4804d7a63cc54394ebd9fe5dec" exitCode=0 Jul 11 03:46:59.300641 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:46:59.300609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" event={"ID":"29797cc5-be08-4971-9074-fa41090a841a","Type":"ContainerDied","Data":"a9546689e0daaf3ff635600fd0568c0bde37ee4804d7a63cc54394ebd9fe5dec"} Jul 11 03:47:00.306120 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:00.306087 2572 generic.go:356] "Generic (PLEG): container finished" podID="29797cc5-be08-4971-9074-fa41090a841a" containerID="c9728ed0ada0719f0b24bf9856bc46da32091e85131068b799021f9c66d8f5cb" exitCode=0 Jul 11 03:47:00.306488 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:00.306138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" event={"ID":"29797cc5-be08-4971-9074-fa41090a841a","Type":"ContainerDied","Data":"c9728ed0ada0719f0b24bf9856bc46da32091e85131068b799021f9c66d8f5cb"} Jul 11 03:47:01.312940 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:01.312905 2572 generic.go:356] "Generic (PLEG): container finished" podID="29797cc5-be08-4971-9074-fa41090a841a" containerID="9fc54a7015939db1f1500faa43c86e9d12807634230f406a880b2efd9017abba" exitCode=0 Jul 11 03:47:01.313311 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:01.312961 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" event={"ID":"29797cc5-be08-4971-9074-fa41090a841a","Type":"ContainerDied","Data":"9fc54a7015939db1f1500faa43c86e9d12807634230f406a880b2efd9017abba"} Jul 11 03:47:02.449436 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.449409 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:47:02.533434 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.533395 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-util\") pod \"29797cc5-be08-4971-9074-fa41090a841a\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " Jul 11 03:47:02.533625 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.533450 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c29br\" (UniqueName: \"kubernetes.io/projected/29797cc5-be08-4971-9074-fa41090a841a-kube-api-access-c29br\") pod \"29797cc5-be08-4971-9074-fa41090a841a\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " Jul 11 03:47:02.533625 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.533531 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-bundle\") pod \"29797cc5-be08-4971-9074-fa41090a841a\" (UID: \"29797cc5-be08-4971-9074-fa41090a841a\") " Jul 11 03:47:02.534322 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.534295 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-bundle" (OuterVolumeSpecName: "bundle") pod "29797cc5-be08-4971-9074-fa41090a841a" (UID: "29797cc5-be08-4971-9074-fa41090a841a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:47:02.535812 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.535784 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29797cc5-be08-4971-9074-fa41090a841a-kube-api-access-c29br" (OuterVolumeSpecName: "kube-api-access-c29br") pod "29797cc5-be08-4971-9074-fa41090a841a" (UID: "29797cc5-be08-4971-9074-fa41090a841a"). InnerVolumeSpecName "kube-api-access-c29br". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:47:02.538791 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.538767 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-util" (OuterVolumeSpecName: "util") pod "29797cc5-be08-4971-9074-fa41090a841a" (UID: "29797cc5-be08-4971-9074-fa41090a841a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:47:02.634555 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.634525 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:47:02.634555 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.634554 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c29br\" (UniqueName: \"kubernetes.io/projected/29797cc5-be08-4971-9074-fa41090a841a-kube-api-access-c29br\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:47:02.634750 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:02.634565 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29797cc5-be08-4971-9074-fa41090a841a-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:47:03.323807 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:03.323777 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" Jul 11 03:47:03.323807 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:03.323784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflqtsb" event={"ID":"29797cc5-be08-4971-9074-fa41090a841a","Type":"ContainerDied","Data":"0acdae041df4d7e1542f03a15331d47d844a7902722c411141c5fc6297be87dd"} Jul 11 03:47:03.324070 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:03.323829 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0acdae041df4d7e1542f03a15331d47d844a7902722c411141c5fc6297be87dd" Jul 11 03:47:10.592308 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592224 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs"] Jul 11 03:47:10.592639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592588 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="util" Jul 11 03:47:10.592639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592602 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="util" Jul 11 03:47:10.592639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592614 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="extract" Jul 11 03:47:10.592639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592620 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="extract" Jul 11 03:47:10.592639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592633 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="pull" Jul 11 03:47:10.592639 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592639 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="pull" Jul 11 03:47:10.592828 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.592704 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="29797cc5-be08-4971-9074-fa41090a841a" containerName="extract" Jul 11 03:47:10.596076 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.596057 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.598402 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.598383 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 11 03:47:10.598506 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.598384 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2vrhl\"" Jul 11 03:47:10.598660 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.598646 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 11 03:47:10.599157 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.599143 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 11 03:47:10.599239 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.599199 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 11 03:47:10.606161 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.606128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d74db17-1118-4b20-abdb-60efdbfa8e4f-tmp\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.606249 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.606169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d74db17-1118-4b20-abdb-60efdbfa8e4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.606249 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.606233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d74db17-1118-4b20-abdb-60efdbfa8e4f-manifests\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.606326 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.606290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5pmg\" (UniqueName: \"kubernetes.io/projected/2d74db17-1118-4b20-abdb-60efdbfa8e4f-kube-api-access-b5pmg\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.606326 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.606320 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d74db17-1118-4b20-abdb-60efdbfa8e4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.614523 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.614455 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs"] Jul 11 03:47:10.706709 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.706673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5pmg\" (UniqueName: \"kubernetes.io/projected/2d74db17-1118-4b20-abdb-60efdbfa8e4f-kube-api-access-b5pmg\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.706709 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.706713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d74db17-1118-4b20-abdb-60efdbfa8e4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.706974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.706863 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d74db17-1118-4b20-abdb-60efdbfa8e4f-tmp\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.706974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.706904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d74db17-1118-4b20-abdb-60efdbfa8e4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.706974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.706937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d74db17-1118-4b20-abdb-60efdbfa8e4f-manifests\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.707315 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.707292 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2d74db17-1118-4b20-abdb-60efdbfa8e4f-manifests\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.709287 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.709266 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d74db17-1118-4b20-abdb-60efdbfa8e4f-tmp\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.709408 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.709394 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2d74db17-1118-4b20-abdb-60efdbfa8e4f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.709470 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.709452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d74db17-1118-4b20-abdb-60efdbfa8e4f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.721210 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.721186 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5pmg\" (UniqueName: \"kubernetes.io/projected/2d74db17-1118-4b20-abdb-60efdbfa8e4f-kube-api-access-b5pmg\") pod \"opendatahub-operator-controller-manager-7766d5cd97-lttqs\" (UID: \"2d74db17-1118-4b20-abdb-60efdbfa8e4f\") " pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:10.906922 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:10.906886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:11.045528 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:11.045500 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs"] Jul 11 03:47:11.048335 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:47:11.048308 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d74db17_1118_4b20_abdb_60efdbfa8e4f.slice/crio-ab87cc0602d893cafa7354916f002dba2c1661d69b88fc093e334ae7325a0026 WatchSource:0}: Error finding container ab87cc0602d893cafa7354916f002dba2c1661d69b88fc093e334ae7325a0026: Status 404 returned error can't find the container with id ab87cc0602d893cafa7354916f002dba2c1661d69b88fc093e334ae7325a0026 Jul 11 03:47:11.360690 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:11.360652 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" event={"ID":"2d74db17-1118-4b20-abdb-60efdbfa8e4f","Type":"ContainerStarted","Data":"ab87cc0602d893cafa7354916f002dba2c1661d69b88fc093e334ae7325a0026"} Jul 11 03:47:14.378555 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:14.378515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" event={"ID":"2d74db17-1118-4b20-abdb-60efdbfa8e4f","Type":"ContainerStarted","Data":"0b9220d4e4c52534da07b0402d0924ddeefb7f45a1b4a609bec5d8a6785d79a2"} Jul 11 03:47:15.384816 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:15.384786 2572 generic.go:356] "Generic (PLEG): container finished" podID="2d74db17-1118-4b20-abdb-60efdbfa8e4f" containerID="0b9220d4e4c52534da07b0402d0924ddeefb7f45a1b4a609bec5d8a6785d79a2" exitCode=0 Jul 11 03:47:15.385184 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:15.384868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" event={"ID":"2d74db17-1118-4b20-abdb-60efdbfa8e4f","Type":"ContainerDied","Data":"0b9220d4e4c52534da07b0402d0924ddeefb7f45a1b4a609bec5d8a6785d79a2"} Jul 11 03:47:16.393534 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:16.393498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" event={"ID":"2d74db17-1118-4b20-abdb-60efdbfa8e4f","Type":"ContainerStarted","Data":"fb590d26f4d6056e6967df3facc0d0bc947fc417b1e8fd3dffdadac16c78a781"} Jul 11 03:47:16.393988 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:16.393605 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:16.414260 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:16.414208 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" podStartSLOduration=1.915974166 podStartE2EDuration="6.414188816s" totalImagesPullingTime="3.427187921s" totalInitContainerRuntime="1.071026729s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:47:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:47:16.413866242 +0000 UTC m=+267.131204470" watchObservedRunningTime="2026-07-11 03:47:16.414188816 +0000 UTC m=+267.131527056" Jul 11 03:47:27.401592 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:27.401560 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7766d5cd97-lttqs" Jul 11 03:47:29.552326 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.552295 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s"] Jul 11 03:47:29.560353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.560330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.562797 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.562775 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kvpwq\"" Jul 11 03:47:29.563676 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.563648 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 11 03:47:29.563792 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.563708 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 11 03:47:29.563792 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.563654 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 11 03:47:29.568334 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.568313 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s"] Jul 11 03:47:29.669958 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.669928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02782830-7a08-4f82-be0d-cd1fab1ffb45-cert\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.670128 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.669990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02782830-7a08-4f82-be0d-cd1fab1ffb45-metrics-cert\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.670128 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.670048 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02782830-7a08-4f82-be0d-cd1fab1ffb45-manager-config\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.670201 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.670135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjjpx\" (UniqueName: \"kubernetes.io/projected/02782830-7a08-4f82-be0d-cd1fab1ffb45-kube-api-access-jjjpx\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.771021 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.770991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02782830-7a08-4f82-be0d-cd1fab1ffb45-metrics-cert\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.771021 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.771025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02782830-7a08-4f82-be0d-cd1fab1ffb45-manager-config\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.771270 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.771063 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjjpx\" (UniqueName: \"kubernetes.io/projected/02782830-7a08-4f82-be0d-cd1fab1ffb45-kube-api-access-jjjpx\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.771270 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.771092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02782830-7a08-4f82-be0d-cd1fab1ffb45-cert\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.771649 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.771626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02782830-7a08-4f82-be0d-cd1fab1ffb45-manager-config\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.773636 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.773612 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02782830-7a08-4f82-be0d-cd1fab1ffb45-cert\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.773743 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.773726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02782830-7a08-4f82-be0d-cd1fab1ffb45-metrics-cert\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.781199 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.781177 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjjpx\" (UniqueName: \"kubernetes.io/projected/02782830-7a08-4f82-be0d-cd1fab1ffb45-kube-api-access-jjjpx\") pod \"lws-controller-manager-6d946858c4-q8q4s\" (UID: \"02782830-7a08-4f82-be0d-cd1fab1ffb45\") " pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.870784 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.870750 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:29.979174 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.979144 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5"] Jul 11 03:47:29.984483 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.984462 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:29.988610 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.988583 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 11 03:47:29.988759 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.988675 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 11 03:47:29.988895 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.988876 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 11 03:47:29.989374 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.989243 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 11 03:47:29.989374 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.989283 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4dhw4\"" Jul 11 03:47:29.999160 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:29.999139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5"] Jul 11 03:47:30.015353 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.015315 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s"] Jul 11 03:47:30.019220 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:47:30.019192 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02782830_7a08_4f82_be0d_cd1fab1ffb45.slice/crio-5b023a08c1744a6b36c881d1bb133403e2e6b3402be1fffa10a501b9135189e1 WatchSource:0}: Error finding container 5b023a08c1744a6b36c881d1bb133403e2e6b3402be1fffa10a501b9135189e1: Status 404 returned error can't find the container with id 5b023a08c1744a6b36c881d1bb133403e2e6b3402be1fffa10a501b9135189e1 Jul 11 03:47:30.073751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.073717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/794e3ffd-5a69-4934-8596-a11653e0372a-tls-certs\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.073751 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.073754 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/794e3ffd-5a69-4934-8596-a11653e0372a-tmp\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.073989 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.073773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmvp\" (UniqueName: \"kubernetes.io/projected/794e3ffd-5a69-4934-8596-a11653e0372a-kube-api-access-8qmvp\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.175113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.175032 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/794e3ffd-5a69-4934-8596-a11653e0372a-tls-certs\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.175113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.175071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/794e3ffd-5a69-4934-8596-a11653e0372a-tmp\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.175113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.175100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmvp\" (UniqueName: \"kubernetes.io/projected/794e3ffd-5a69-4934-8596-a11653e0372a-kube-api-access-8qmvp\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.177391 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.177372 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/794e3ffd-5a69-4934-8596-a11653e0372a-tmp\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.177609 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.177592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/794e3ffd-5a69-4934-8596-a11653e0372a-tls-certs\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.182422 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.182403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmvp\" (UniqueName: \"kubernetes.io/projected/794e3ffd-5a69-4934-8596-a11653e0372a-kube-api-access-8qmvp\") pod \"kube-auth-proxy-67cfbd58d5-8hfc5\" (UID: \"794e3ffd-5a69-4934-8596-a11653e0372a\") " pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.295902 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.295811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" Jul 11 03:47:30.441401 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.441374 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5"] Jul 11 03:47:30.443563 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:47:30.443527 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794e3ffd_5a69_4934_8596_a11653e0372a.slice/crio-892f9d1cce78ca58e6cef582509ce26701116fe17f1199db75708f1474d86c1f WatchSource:0}: Error finding container 892f9d1cce78ca58e6cef582509ce26701116fe17f1199db75708f1474d86c1f: Status 404 returned error can't find the container with id 892f9d1cce78ca58e6cef582509ce26701116fe17f1199db75708f1474d86c1f Jul 11 03:47:30.464365 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.464330 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" event={"ID":"794e3ffd-5a69-4934-8596-a11653e0372a","Type":"ContainerStarted","Data":"892f9d1cce78ca58e6cef582509ce26701116fe17f1199db75708f1474d86c1f"} Jul 11 03:47:30.465611 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:30.465587 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" event={"ID":"02782830-7a08-4f82-be0d-cd1fab1ffb45","Type":"ContainerStarted","Data":"5b023a08c1744a6b36c881d1bb133403e2e6b3402be1fffa10a501b9135189e1"} Jul 11 03:47:32.480925 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:32.480889 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" event={"ID":"02782830-7a08-4f82-be0d-cd1fab1ffb45","Type":"ContainerStarted","Data":"50e17f46506b939bf886186cbed08c531b24df0bb54ac1126b3f89f093a1063f"} Jul 11 03:47:32.481380 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:32.480967 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:32.497850 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:32.497788 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" podStartSLOduration=1.615618059 podStartE2EDuration="3.497743308s" totalImagesPullingTime="1.882125249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:47:32.496506418 +0000 UTC m=+283.213844657" watchObservedRunningTime="2026-07-11 03:47:32.497743308 +0000 UTC m=+283.215081537" Jul 11 03:47:33.488134 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:33.488097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" event={"ID":"794e3ffd-5a69-4934-8596-a11653e0372a","Type":"ContainerStarted","Data":"1103236f923a0384668943533e9fbdf81bd1c8d5dcc645dab975e9a4eac716ab"} Jul 11 03:47:33.512962 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:33.512909 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67cfbd58d5-8hfc5" podStartSLOduration=1.638440122 podStartE2EDuration="4.512889975s" totalImagesPullingTime="2.874449853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:47:33.504804571 +0000 UTC m=+284.222142808" watchObservedRunningTime="2026-07-11 03:47:33.512889975 +0000 UTC m=+284.230228212" Jul 11 03:47:43.490173 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:43.490144 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d946858c4-q8q4s" Jul 11 03:47:49.724098 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:47:49.724072 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 11 03:48:46.278689 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.278604 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p"] Jul 11 03:48:46.282058 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.282041 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.284265 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.284240 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 11 03:48:46.284389 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.284242 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 11 03:48:46.285057 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.285036 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-p7m6x\"" Jul 11 03:48:46.289680 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.289656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p"] Jul 11 03:48:46.337075 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.337038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.337257 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.337096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.337257 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.337124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ghxf\" (UniqueName: \"kubernetes.io/projected/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-kube-api-access-6ghxf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.437574 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.437535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.437771 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.437595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.437771 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.437619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ghxf\" (UniqueName: \"kubernetes.io/projected/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-kube-api-access-6ghxf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.437991 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.437968 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.437991 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.437980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.445270 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.445251 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ghxf\" (UniqueName: \"kubernetes.io/projected/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-kube-api-access-6ghxf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.592345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.592267 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:46.726520 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.726495 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p"] Jul 11 03:48:46.728968 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:48:46.728942 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc801dd_f624_4ab0_bd93_d5fa81d03bc6.slice/crio-555e5471d4f88f613fec7ca6add6e4f5eff18d6a7645f015953d560156b05a31 WatchSource:0}: Error finding container 555e5471d4f88f613fec7ca6add6e4f5eff18d6a7645f015953d560156b05a31: Status 404 returned error can't find the container with id 555e5471d4f88f613fec7ca6add6e4f5eff18d6a7645f015953d560156b05a31 Jul 11 03:48:46.833483 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.833452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" event={"ID":"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6","Type":"ContainerStarted","Data":"779126702a1aec3ad3fce4cf62c4dcca00143888c39f5f0ce25296c17b1d5d59"} Jul 11 03:48:46.833605 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:46.833507 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" event={"ID":"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6","Type":"ContainerStarted","Data":"555e5471d4f88f613fec7ca6add6e4f5eff18d6a7645f015953d560156b05a31"} Jul 11 03:48:47.079998 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.079959 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6"] Jul 11 03:48:47.083727 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.083707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.090821 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.090793 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6"] Jul 11 03:48:47.142676 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.142644 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.142830 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.142704 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.142830 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.142761 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lrsd\" (UniqueName: \"kubernetes.io/projected/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-kube-api-access-6lrsd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.243571 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.243533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.243756 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.243615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.243756 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.243684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lrsd\" (UniqueName: \"kubernetes.io/projected/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-kube-api-access-6lrsd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.243983 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.243961 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.244061 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.243982 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.251451 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.251431 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lrsd\" (UniqueName: \"kubernetes.io/projected/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-kube-api-access-6lrsd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.394437 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.394406 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:47.523176 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.523120 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6"] Jul 11 03:48:47.525511 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:48:47.525484 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a190f80_cbbe_42ad_b4b7_0b4d5f13e856.slice/crio-e8f0c699bfc8c5c8123542f50cb41fdd015be94f4125d0af930928de60e9d011 WatchSource:0}: Error finding container e8f0c699bfc8c5c8123542f50cb41fdd015be94f4125d0af930928de60e9d011: Status 404 returned error can't find the container with id e8f0c699bfc8c5c8123542f50cb41fdd015be94f4125d0af930928de60e9d011 Jul 11 03:48:47.675520 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.675442 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67"] Jul 11 03:48:47.679042 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.679026 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.686382 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.686353 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67"] Jul 11 03:48:47.748258 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.748224 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.748258 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.748261 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.748467 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.748288 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4m2t\" (UniqueName: \"kubernetes.io/projected/e4b591ad-5b98-4b81-941f-0d99a572f013-kube-api-access-p4m2t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.841606 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.841575 2572 generic.go:356] "Generic (PLEG): container finished" podID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerID="779126702a1aec3ad3fce4cf62c4dcca00143888c39f5f0ce25296c17b1d5d59" exitCode=0 Jul 11 03:48:47.841793 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.841632 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" event={"ID":"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6","Type":"ContainerDied","Data":"779126702a1aec3ad3fce4cf62c4dcca00143888c39f5f0ce25296c17b1d5d59"} Jul 11 03:48:47.842198 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.842179 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 03:48:47.843145 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.843115 2572 generic.go:356] "Generic (PLEG): container finished" podID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerID="fba08a62bf647e56cc6229ea8d30d1e10a8de61863987216096f01c049bb0ba7" exitCode=0 Jul 11 03:48:47.843233 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.843148 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" event={"ID":"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856","Type":"ContainerDied","Data":"fba08a62bf647e56cc6229ea8d30d1e10a8de61863987216096f01c049bb0ba7"} Jul 11 03:48:47.843233 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.843196 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" event={"ID":"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856","Type":"ContainerStarted","Data":"e8f0c699bfc8c5c8123542f50cb41fdd015be94f4125d0af930928de60e9d011"} Jul 11 03:48:47.850049 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.850022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.850155 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.850075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.850155 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.850115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4m2t\" (UniqueName: \"kubernetes.io/projected/e4b591ad-5b98-4b81-941f-0d99a572f013-kube-api-access-p4m2t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.856146 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.850442 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.856146 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.854007 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.860920 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.860901 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4m2t\" (UniqueName: \"kubernetes.io/projected/e4b591ad-5b98-4b81-941f-0d99a572f013-kube-api-access-p4m2t\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:47.989469 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:47.989366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:48.078879 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.078829 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27"] Jul 11 03:48:48.083225 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.083199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.093250 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.091632 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27"] Jul 11 03:48:48.125318 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.125291 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67"] Jul 11 03:48:48.127032 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:48:48.127007 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b591ad_5b98_4b81_941f_0d99a572f013.slice/crio-de1d6ecdfca9f38029138677de5bc2fc3d526ea9a4873294301abe068de1451b WatchSource:0}: Error finding container de1d6ecdfca9f38029138677de5bc2fc3d526ea9a4873294301abe068de1451b: Status 404 returned error can't find the container with id de1d6ecdfca9f38029138677de5bc2fc3d526ea9a4873294301abe068de1451b Jul 11 03:48:48.152214 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.152191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.152298 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.152235 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.152348 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.152306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w68v\" (UniqueName: \"kubernetes.io/projected/76747892-3b00-41cc-912a-6691b526005f-kube-api-access-2w68v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.253211 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.253143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.253211 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.253199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w68v\" (UniqueName: \"kubernetes.io/projected/76747892-3b00-41cc-912a-6691b526005f-kube-api-access-2w68v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.253354 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.253243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.253544 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.253530 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.253580 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.253528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.265867 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.265821 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w68v\" (UniqueName: \"kubernetes.io/projected/76747892-3b00-41cc-912a-6691b526005f-kube-api-access-2w68v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.396684 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.396645 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:48.714087 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.714060 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27"] Jul 11 03:48:48.763068 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:48:48.763032 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76747892_3b00_41cc_912a_6691b526005f.slice/crio-21bdcb91c50601a87270affa6d99946ecc65e3c82b4a6fa77b7fbf448ac218e9 WatchSource:0}: Error finding container 21bdcb91c50601a87270affa6d99946ecc65e3c82b4a6fa77b7fbf448ac218e9: Status 404 returned error can't find the container with id 21bdcb91c50601a87270affa6d99946ecc65e3c82b4a6fa77b7fbf448ac218e9 Jul 11 03:48:48.850135 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.850099 2572 generic.go:356] "Generic (PLEG): container finished" podID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerID="20bf442d9ad04902e197ec0d956680ba807b854c1c05621b31d57636928fbb8e" exitCode=0 Jul 11 03:48:48.850278 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.850183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" event={"ID":"e4b591ad-5b98-4b81-941f-0d99a572f013","Type":"ContainerDied","Data":"20bf442d9ad04902e197ec0d956680ba807b854c1c05621b31d57636928fbb8e"} Jul 11 03:48:48.850278 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.850237 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" event={"ID":"e4b591ad-5b98-4b81-941f-0d99a572f013","Type":"ContainerStarted","Data":"de1d6ecdfca9f38029138677de5bc2fc3d526ea9a4873294301abe068de1451b"} Jul 11 03:48:48.852491 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.852456 2572 generic.go:356] "Generic (PLEG): container finished" podID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerID="f51a875419f946f8f3df191d3ecafb774fd0e03b2336ddc8504aaa097d889df4" exitCode=0 Jul 11 03:48:48.852604 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.852560 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" event={"ID":"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6","Type":"ContainerDied","Data":"f51a875419f946f8f3df191d3ecafb774fd0e03b2336ddc8504aaa097d889df4"} Jul 11 03:48:48.854857 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.854819 2572 generic.go:356] "Generic (PLEG): container finished" podID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerID="1af4fb88043349c608836684824b062cfb4bf60ff5237a095982e560ffac4400" exitCode=0 Jul 11 03:48:48.854957 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.854867 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" event={"ID":"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856","Type":"ContainerDied","Data":"1af4fb88043349c608836684824b062cfb4bf60ff5237a095982e560ffac4400"} Jul 11 03:48:48.856601 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.856578 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" event={"ID":"76747892-3b00-41cc-912a-6691b526005f","Type":"ContainerStarted","Data":"d76e9941c730e3b8be930c810a837cb8e6bcbdec458d2568a58c3c450c34d748"} Jul 11 03:48:48.856756 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:48.856623 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" event={"ID":"76747892-3b00-41cc-912a-6691b526005f","Type":"ContainerStarted","Data":"21bdcb91c50601a87270affa6d99946ecc65e3c82b4a6fa77b7fbf448ac218e9"} Jul 11 03:48:49.868584 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.868522 2572 generic.go:356] "Generic (PLEG): container finished" podID="76747892-3b00-41cc-912a-6691b526005f" containerID="d76e9941c730e3b8be930c810a837cb8e6bcbdec458d2568a58c3c450c34d748" exitCode=0 Jul 11 03:48:49.869080 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.868618 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" event={"ID":"76747892-3b00-41cc-912a-6691b526005f","Type":"ContainerDied","Data":"d76e9941c730e3b8be930c810a837cb8e6bcbdec458d2568a58c3c450c34d748"} Jul 11 03:48:49.870619 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.870593 2572 generic.go:356] "Generic (PLEG): container finished" podID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerID="13bbaa6da659e79866b42d5808a5fda881c0476f87e4309963160d9c7b2f1d63" exitCode=0 Jul 11 03:48:49.870758 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.870730 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" event={"ID":"e4b591ad-5b98-4b81-941f-0d99a572f013","Type":"ContainerDied","Data":"13bbaa6da659e79866b42d5808a5fda881c0476f87e4309963160d9c7b2f1d63"} Jul 11 03:48:49.873345 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.873320 2572 generic.go:356] "Generic (PLEG): container finished" podID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerID="149b148deb2c03c8f2afe0dbdf3ca5ee6a99c698196e4e60d40daabbf87d940f" exitCode=0 Jul 11 03:48:49.873457 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.873408 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" event={"ID":"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6","Type":"ContainerDied","Data":"149b148deb2c03c8f2afe0dbdf3ca5ee6a99c698196e4e60d40daabbf87d940f"} Jul 11 03:48:49.875437 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.875398 2572 generic.go:356] "Generic (PLEG): container finished" podID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerID="65dadd63074f78cf99bde36a9b61d4bb5b35ea773591c76e7661442784901c97" exitCode=0 Jul 11 03:48:49.875510 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:49.875450 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" event={"ID":"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856","Type":"ContainerDied","Data":"65dadd63074f78cf99bde36a9b61d4bb5b35ea773591c76e7661442784901c97"} Jul 11 03:48:50.881894 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:50.881835 2572 generic.go:356] "Generic (PLEG): container finished" podID="76747892-3b00-41cc-912a-6691b526005f" containerID="f2a5c959dcd467f91994c7a99f090c23023a24c7418cb25496dea3a14dccf913" exitCode=0 Jul 11 03:48:50.882279 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:50.881948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" event={"ID":"76747892-3b00-41cc-912a-6691b526005f","Type":"ContainerDied","Data":"f2a5c959dcd467f91994c7a99f090c23023a24c7418cb25496dea3a14dccf913"} Jul 11 03:48:50.884184 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:50.884154 2572 generic.go:356] "Generic (PLEG): container finished" podID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerID="116bc0ff3491d5e3c025acf7120cd0652a5d41a35bc6339182f74c49a59f75f1" exitCode=0 Jul 11 03:48:50.884289 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:50.884238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" event={"ID":"e4b591ad-5b98-4b81-941f-0d99a572f013","Type":"ContainerDied","Data":"116bc0ff3491d5e3c025acf7120cd0652a5d41a35bc6339182f74c49a59f75f1"} Jul 11 03:48:51.035567 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.035540 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:51.046985 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.046954 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:51.072458 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.072430 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ghxf\" (UniqueName: \"kubernetes.io/projected/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-kube-api-access-6ghxf\") pod \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " Jul 11 03:48:51.072633 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.072473 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-util\") pod \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " Jul 11 03:48:51.072633 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.072512 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-util\") pod \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " Jul 11 03:48:51.072633 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.072551 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lrsd\" (UniqueName: \"kubernetes.io/projected/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-kube-api-access-6lrsd\") pod \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " Jul 11 03:48:51.072633 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.072602 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-bundle\") pod \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\" (UID: \"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6\") " Jul 11 03:48:51.072865 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.072634 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-bundle\") pod \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\" (UID: \"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856\") " Jul 11 03:48:51.073164 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.073112 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-bundle" (OuterVolumeSpecName: "bundle") pod "4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" (UID: "4cc801dd-f624-4ab0-bd93-d5fa81d03bc6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:51.074428 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.073563 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-bundle" (OuterVolumeSpecName: "bundle") pod "7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" (UID: "7a190f80-cbbe-42ad-b4b7-0b4d5f13e856"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:51.075290 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.075260 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-kube-api-access-6lrsd" (OuterVolumeSpecName: "kube-api-access-6lrsd") pod "7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" (UID: "7a190f80-cbbe-42ad-b4b7-0b4d5f13e856"). InnerVolumeSpecName "kube-api-access-6lrsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:48:51.075376 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.075341 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-kube-api-access-6ghxf" (OuterVolumeSpecName: "kube-api-access-6ghxf") pod "4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" (UID: "4cc801dd-f624-4ab0-bd93-d5fa81d03bc6"). InnerVolumeSpecName "kube-api-access-6ghxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:48:51.078808 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.078785 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-util" (OuterVolumeSpecName: "util") pod "7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" (UID: "7a190f80-cbbe-42ad-b4b7-0b4d5f13e856"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:51.081677 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.081658 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-util" (OuterVolumeSpecName: "util") pod "4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" (UID: "4cc801dd-f624-4ab0-bd93-d5fa81d03bc6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:51.173548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.173466 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ghxf\" (UniqueName: \"kubernetes.io/projected/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-kube-api-access-6ghxf\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:51.173548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.173495 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:51.173548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.173504 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:51.173548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.173512 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lrsd\" (UniqueName: \"kubernetes.io/projected/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-kube-api-access-6lrsd\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:51.173548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.173521 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cc801dd-f624-4ab0-bd93-d5fa81d03bc6-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:51.173548 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.173529 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a190f80-cbbe-42ad-b4b7-0b4d5f13e856-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:51.891195 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.891167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" event={"ID":"4cc801dd-f624-4ab0-bd93-d5fa81d03bc6","Type":"ContainerDied","Data":"555e5471d4f88f613fec7ca6add6e4f5eff18d6a7645f015953d560156b05a31"} Jul 11 03:48:51.891610 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.891213 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="555e5471d4f88f613fec7ca6add6e4f5eff18d6a7645f015953d560156b05a31" Jul 11 03:48:51.891610 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.891179 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p" Jul 11 03:48:51.893265 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.893215 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" Jul 11 03:48:51.893265 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.893227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6" event={"ID":"7a190f80-cbbe-42ad-b4b7-0b4d5f13e856","Type":"ContainerDied","Data":"e8f0c699bfc8c5c8123542f50cb41fdd015be94f4125d0af930928de60e9d011"} Jul 11 03:48:51.893471 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.893268 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f0c699bfc8c5c8123542f50cb41fdd015be94f4125d0af930928de60e9d011" Jul 11 03:48:51.895670 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.895646 2572 generic.go:356] "Generic (PLEG): container finished" podID="76747892-3b00-41cc-912a-6691b526005f" containerID="537fc7b19c6008bc72b76424986837632da6faf5d017022cb253dcb7376ebe37" exitCode=0 Jul 11 03:48:51.895759 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:51.895722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" event={"ID":"76747892-3b00-41cc-912a-6691b526005f","Type":"ContainerDied","Data":"537fc7b19c6008bc72b76424986837632da6faf5d017022cb253dcb7376ebe37"} Jul 11 03:48:52.035370 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.035345 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:52.079675 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.079646 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-bundle\") pod \"e4b591ad-5b98-4b81-941f-0d99a572f013\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " Jul 11 03:48:52.079889 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.079700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4m2t\" (UniqueName: \"kubernetes.io/projected/e4b591ad-5b98-4b81-941f-0d99a572f013-kube-api-access-p4m2t\") pod \"e4b591ad-5b98-4b81-941f-0d99a572f013\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " Jul 11 03:48:52.079889 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.079774 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-util\") pod \"e4b591ad-5b98-4b81-941f-0d99a572f013\" (UID: \"e4b591ad-5b98-4b81-941f-0d99a572f013\") " Jul 11 03:48:52.080244 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.080220 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-bundle" (OuterVolumeSpecName: "bundle") pod "e4b591ad-5b98-4b81-941f-0d99a572f013" (UID: "e4b591ad-5b98-4b81-941f-0d99a572f013"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:52.081980 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.081952 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b591ad-5b98-4b81-941f-0d99a572f013-kube-api-access-p4m2t" (OuterVolumeSpecName: "kube-api-access-p4m2t") pod "e4b591ad-5b98-4b81-941f-0d99a572f013" (UID: "e4b591ad-5b98-4b81-941f-0d99a572f013"). InnerVolumeSpecName "kube-api-access-p4m2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:48:52.084920 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.084885 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-util" (OuterVolumeSpecName: "util") pod "e4b591ad-5b98-4b81-941f-0d99a572f013" (UID: "e4b591ad-5b98-4b81-941f-0d99a572f013"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:52.180436 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.180402 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:52.180436 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.180432 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4m2t\" (UniqueName: \"kubernetes.io/projected/e4b591ad-5b98-4b81-941f-0d99a572f013-kube-api-access-p4m2t\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:52.180436 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.180442 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4b591ad-5b98-4b81-941f-0d99a572f013-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:52.903635 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.903608 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" Jul 11 03:48:52.903635 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.903637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67" event={"ID":"e4b591ad-5b98-4b81-941f-0d99a572f013","Type":"ContainerDied","Data":"de1d6ecdfca9f38029138677de5bc2fc3d526ea9a4873294301abe068de1451b"} Jul 11 03:48:52.904152 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:52.903684 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de1d6ecdfca9f38029138677de5bc2fc3d526ea9a4873294301abe068de1451b" Jul 11 03:48:53.037413 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.037393 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:53.086415 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.086382 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w68v\" (UniqueName: \"kubernetes.io/projected/76747892-3b00-41cc-912a-6691b526005f-kube-api-access-2w68v\") pod \"76747892-3b00-41cc-912a-6691b526005f\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " Jul 11 03:48:53.086559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.086459 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-bundle\") pod \"76747892-3b00-41cc-912a-6691b526005f\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " Jul 11 03:48:53.086559 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.086492 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-util\") pod \"76747892-3b00-41cc-912a-6691b526005f\" (UID: \"76747892-3b00-41cc-912a-6691b526005f\") " Jul 11 03:48:53.087069 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.087033 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-bundle" (OuterVolumeSpecName: "bundle") pod "76747892-3b00-41cc-912a-6691b526005f" (UID: "76747892-3b00-41cc-912a-6691b526005f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:53.088627 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.088596 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76747892-3b00-41cc-912a-6691b526005f-kube-api-access-2w68v" (OuterVolumeSpecName: "kube-api-access-2w68v") pod "76747892-3b00-41cc-912a-6691b526005f" (UID: "76747892-3b00-41cc-912a-6691b526005f"). InnerVolumeSpecName "kube-api-access-2w68v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:48:53.091970 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.091927 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-util" (OuterVolumeSpecName: "util") pod "76747892-3b00-41cc-912a-6691b526005f" (UID: "76747892-3b00-41cc-912a-6691b526005f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 03:48:53.187599 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.187506 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:53.187599 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.187536 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76747892-3b00-41cc-912a-6691b526005f-util\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:53.187599 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.187547 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w68v\" (UniqueName: \"kubernetes.io/projected/76747892-3b00-41cc-912a-6691b526005f-kube-api-access-2w68v\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:48:53.910295 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.910272 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" Jul 11 03:48:53.910668 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.910290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27" event={"ID":"76747892-3b00-41cc-912a-6691b526005f","Type":"ContainerDied","Data":"21bdcb91c50601a87270affa6d99946ecc65e3c82b4a6fa77b7fbf448ac218e9"} Jul 11 03:48:53.910668 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:48:53.910336 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21bdcb91c50601a87270affa6d99946ecc65e3c82b4a6fa77b7fbf448ac218e9" Jul 11 03:49:24.151245 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151215 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z"] Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151586 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="util" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151596 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="util" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151603 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151608 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151615 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151620 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151628 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="pull" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151633 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="pull" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151640 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="pull" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151645 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="pull" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151653 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151661 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151674 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="pull" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151679 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="pull" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151684 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="extract" Jul 11 03:49:24.151682 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151689 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="extract" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151694 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="pull" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151699 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="pull" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151720 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="util" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151724 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="util" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151730 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="util" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151734 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="util" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151744 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="util" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151749 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="util" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151804 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a190f80-cbbe-42ad-b4b7-0b4d5f13e856" containerName="extract" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151811 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b591ad-5b98-4b81-941f-0d99a572f013" containerName="extract" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151818 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76747892-3b00-41cc-912a-6691b526005f" containerName="extract" Jul 11 03:49:24.152207 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.151823 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc801dd-f624-4ab0-bd93-d5fa81d03bc6" containerName="extract" Jul 11 03:49:24.156718 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.156697 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:24.159173 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.159152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-k8k6d\"" Jul 11 03:49:24.159974 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.159951 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 11 03:49:24.160101 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.159953 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 11 03:49:24.166908 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.166887 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z"] Jul 11 03:49:24.215054 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.215021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6nz6\" (UniqueName: \"kubernetes.io/projected/d37376e5-5cc2-4626-be1a-39959180ef65-kube-api-access-g6nz6\") pod \"limitador-operator-controller-manager-859d7b78bd-tgs9z\" (UID: \"d37376e5-5cc2-4626-be1a-39959180ef65\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:24.316362 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.316330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6nz6\" (UniqueName: \"kubernetes.io/projected/d37376e5-5cc2-4626-be1a-39959180ef65-kube-api-access-g6nz6\") pod \"limitador-operator-controller-manager-859d7b78bd-tgs9z\" (UID: \"d37376e5-5cc2-4626-be1a-39959180ef65\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:24.324014 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.323983 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6nz6\" (UniqueName: \"kubernetes.io/projected/d37376e5-5cc2-4626-be1a-39959180ef65-kube-api-access-g6nz6\") pod \"limitador-operator-controller-manager-859d7b78bd-tgs9z\" (UID: \"d37376e5-5cc2-4626-be1a-39959180ef65\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:24.468042 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.467971 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:24.603764 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:24.603742 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z"] Jul 11 03:49:24.605599 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:49:24.605572 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37376e5_5cc2_4626_be1a_39959180ef65.slice/crio-bfd3963e8943c938bf9bf836b4ed795cbd87e7c2c0da6a1e21acc01e9c08037d WatchSource:0}: Error finding container bfd3963e8943c938bf9bf836b4ed795cbd87e7c2c0da6a1e21acc01e9c08037d: Status 404 returned error can't find the container with id bfd3963e8943c938bf9bf836b4ed795cbd87e7c2c0da6a1e21acc01e9c08037d Jul 11 03:49:25.079916 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:25.079874 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" event={"ID":"d37376e5-5cc2-4626-be1a-39959180ef65","Type":"ContainerStarted","Data":"bfd3963e8943c938bf9bf836b4ed795cbd87e7c2c0da6a1e21acc01e9c08037d"} Jul 11 03:49:27.092945 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:27.092906 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" event={"ID":"d37376e5-5cc2-4626-be1a-39959180ef65","Type":"ContainerStarted","Data":"cc84fb7249f7ce05edc82d528d8f0a2003c92b70d466b531ad926eaa535c6987"} Jul 11 03:49:27.093351 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:27.093088 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:27.111348 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:27.111303 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" podStartSLOduration=1.48470882 podStartE2EDuration="3.111289577s" totalImagesPullingTime="1.626580757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:49:27.108240598 +0000 UTC m=+397.825578834" watchObservedRunningTime="2026-07-11 03:49:27.111289577 +0000 UTC m=+397.828627815" Jul 11 03:49:38.100455 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:38.100416 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tgs9z" Jul 11 03:49:57.622465 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:49:57.622435 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d45d96b-jnjt6"] Jul 11 03:50:10.499611 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.499525 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4vvg9"] Jul 11 03:50:10.505930 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.505914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:10.508658 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.508637 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4xzb4\"" Jul 11 03:50:10.521078 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.521060 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4vvg9"] Jul 11 03:50:10.523067 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.523044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrrs\" (UniqueName: \"kubernetes.io/projected/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff-kube-api-access-bdrrs\") pod \"authorino-58cd955675-4vvg9\" (UID: \"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff\") " pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:10.623852 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.623819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrrs\" (UniqueName: \"kubernetes.io/projected/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff-kube-api-access-bdrrs\") pod \"authorino-58cd955675-4vvg9\" (UID: \"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff\") " pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:10.639943 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.639921 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrrs\" (UniqueName: \"kubernetes.io/projected/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff-kube-api-access-bdrrs\") pod \"authorino-58cd955675-4vvg9\" (UID: \"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff\") " pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:10.815257 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.815180 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:10.823960 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.823932 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-c66g5"] Jul 11 03:50:10.828113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.828096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:10.835136 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.834916 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c66g5"] Jul 11 03:50:10.926530 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.926492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpwq\" (UniqueName: \"kubernetes.io/projected/2c7dbdb7-40c1-4d44-8252-46090a6a2452-kube-api-access-4fpwq\") pod \"authorino-75d556bd77-c66g5\" (UID: \"2c7dbdb7-40c1-4d44-8252-46090a6a2452\") " pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:10.953377 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:10.953355 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4vvg9"] Jul 11 03:50:10.955580 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:50:10.955539 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod889e2e3f_98ff_48d7_a060_3a0ca0e3b5ff.slice/crio-9a6bc22a0cea3178e547dca501c64dedd7c9ca7fe5fd50b8f880e42a37a69a3c WatchSource:0}: Error finding container 9a6bc22a0cea3178e547dca501c64dedd7c9ca7fe5fd50b8f880e42a37a69a3c: Status 404 returned error can't find the container with id 9a6bc22a0cea3178e547dca501c64dedd7c9ca7fe5fd50b8f880e42a37a69a3c Jul 11 03:50:11.028194 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:11.028163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpwq\" (UniqueName: \"kubernetes.io/projected/2c7dbdb7-40c1-4d44-8252-46090a6a2452-kube-api-access-4fpwq\") pod \"authorino-75d556bd77-c66g5\" (UID: \"2c7dbdb7-40c1-4d44-8252-46090a6a2452\") " pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:11.035747 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:11.035723 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpwq\" (UniqueName: \"kubernetes.io/projected/2c7dbdb7-40c1-4d44-8252-46090a6a2452-kube-api-access-4fpwq\") pod \"authorino-75d556bd77-c66g5\" (UID: \"2c7dbdb7-40c1-4d44-8252-46090a6a2452\") " pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:11.156762 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:11.156732 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:11.284145 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:11.284123 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c66g5"] Jul 11 03:50:11.286293 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:50:11.286267 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c7dbdb7_40c1_4d44_8252_46090a6a2452.slice/crio-556e4ac5cd8ebd7a78dc95558a9539cf3be089e853b26788b19e9a5bcec74a0b WatchSource:0}: Error finding container 556e4ac5cd8ebd7a78dc95558a9539cf3be089e853b26788b19e9a5bcec74a0b: Status 404 returned error can't find the container with id 556e4ac5cd8ebd7a78dc95558a9539cf3be089e853b26788b19e9a5bcec74a0b Jul 11 03:50:11.322965 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:11.322934 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c66g5" event={"ID":"2c7dbdb7-40c1-4d44-8252-46090a6a2452","Type":"ContainerStarted","Data":"556e4ac5cd8ebd7a78dc95558a9539cf3be089e853b26788b19e9a5bcec74a0b"} Jul 11 03:50:11.324231 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:11.324210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4vvg9" event={"ID":"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff","Type":"ContainerStarted","Data":"9a6bc22a0cea3178e547dca501c64dedd7c9ca7fe5fd50b8f880e42a37a69a3c"} Jul 11 03:50:15.359045 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:15.358989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c66g5" event={"ID":"2c7dbdb7-40c1-4d44-8252-46090a6a2452","Type":"ContainerStarted","Data":"0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929"} Jul 11 03:50:15.360420 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:15.360393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4vvg9" event={"ID":"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff","Type":"ContainerStarted","Data":"89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc"} Jul 11 03:50:15.374238 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:15.374197 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-c66g5" podStartSLOduration=2.227901131 podStartE2EDuration="5.374183132s" totalImagesPullingTime="3.146282001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:15.37264823 +0000 UTC m=+446.089986471" watchObservedRunningTime="2026-07-11 03:50:15.374183132 +0000 UTC m=+446.091521369" Jul 11 03:50:15.386892 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:15.386824 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4vvg9" podStartSLOduration=1.9216866559999999 podStartE2EDuration="5.386811898s" totalImagesPullingTime="3.465125242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:15.385455019 +0000 UTC m=+446.102793257" watchObservedRunningTime="2026-07-11 03:50:15.386811898 +0000 UTC m=+446.104150174" Jul 11 03:50:15.410049 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:15.410017 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4vvg9"] Jul 11 03:50:17.371025 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:17.370977 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4vvg9" podUID="889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" containerName="authorino" containerID="cri-o://89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc" gracePeriod=30 Jul 11 03:50:17.614910 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:17.614889 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:17.687585 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:17.687509 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdrrs\" (UniqueName: \"kubernetes.io/projected/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff-kube-api-access-bdrrs\") pod \"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff\" (UID: \"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff\") " Jul 11 03:50:17.689638 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:17.689607 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff-kube-api-access-bdrrs" (OuterVolumeSpecName: "kube-api-access-bdrrs") pod "889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" (UID: "889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff"). InnerVolumeSpecName "kube-api-access-bdrrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:50:17.788260 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:17.788220 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdrrs\" (UniqueName: \"kubernetes.io/projected/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff-kube-api-access-bdrrs\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:18.376927 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.376887 2572 generic.go:356] "Generic (PLEG): container finished" podID="889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" containerID="89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc" exitCode=0 Jul 11 03:50:18.376927 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.376928 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4vvg9" Jul 11 03:50:18.377386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.376946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4vvg9" event={"ID":"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff","Type":"ContainerDied","Data":"89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc"} Jul 11 03:50:18.377386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.376981 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4vvg9" event={"ID":"889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff","Type":"ContainerDied","Data":"9a6bc22a0cea3178e547dca501c64dedd7c9ca7fe5fd50b8f880e42a37a69a3c"} Jul 11 03:50:18.377386 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.377004 2572 scope.go:117] "RemoveContainer" containerID="89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc" Jul 11 03:50:18.385617 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.385600 2572 scope.go:117] "RemoveContainer" containerID="89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc" Jul 11 03:50:18.385910 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:50:18.385888 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc\": container with ID starting with 89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc not found: ID does not exist" containerID="89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc" Jul 11 03:50:18.385998 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.385920 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc"} err="failed to get container status \"89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc\": rpc error: code = NotFound desc = could not find container \"89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc\": container with ID starting with 89f8495a333c053a459b5e5d81d12587afd2bde3b1cee907b59a07b3899636cc not found: ID does not exist" Jul 11 03:50:18.391957 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.391933 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4vvg9"] Jul 11 03:50:18.395412 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:18.395391 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4vvg9"] Jul 11 03:50:19.835940 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:19.835908 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" path="/var/lib/kubelet/pods/889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff/volumes" Jul 11 03:50:22.643884 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.643801 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-664d45d96b-jnjt6" podUID="d74eaa60-c56e-4eec-9ac8-25e8b064332f" containerName="console" containerID="cri-o://bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e" gracePeriod=15 Jul 11 03:50:22.888666 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.888642 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:50:22.934747 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.934666 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-oauth-serving-cert\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.934747 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.934700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-serving-cert\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.934747 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.934735 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-config\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.935005 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.934751 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-trusted-ca-bundle\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.935005 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.934778 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jk88\" (UniqueName: \"kubernetes.io/projected/d74eaa60-c56e-4eec-9ac8-25e8b064332f-kube-api-access-7jk88\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.935005 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.934973 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-oauth-config\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.935159 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935038 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-service-ca\") pod \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\" (UID: \"d74eaa60-c56e-4eec-9ac8-25e8b064332f\") " Jul 11 03:50:22.935261 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935134 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:50:22.935320 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935295 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-config" (OuterVolumeSpecName: "console-config") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:50:22.935377 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935359 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:50:22.935431 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935356 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 03:50:22.935483 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935448 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-oauth-serving-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:22.935483 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.935470 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:22.937060 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.937032 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:50:22.937200 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.937177 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:50:22.937282 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:22.937263 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74eaa60-c56e-4eec-9ac8-25e8b064332f-kube-api-access-7jk88" (OuterVolumeSpecName: "kube-api-access-7jk88") pod "d74eaa60-c56e-4eec-9ac8-25e8b064332f" (UID: "d74eaa60-c56e-4eec-9ac8-25e8b064332f"). InnerVolumeSpecName "kube-api-access-7jk88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:50:23.036883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.036820 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jk88\" (UniqueName: \"kubernetes.io/projected/d74eaa60-c56e-4eec-9ac8-25e8b064332f-kube-api-access-7jk88\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:23.036883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.036877 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-oauth-config\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:23.036883 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.036888 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-service-ca\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:23.037111 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.036898 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d74eaa60-c56e-4eec-9ac8-25e8b064332f-console-serving-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:23.037111 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.036906 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d74eaa60-c56e-4eec-9ac8-25e8b064332f-trusted-ca-bundle\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:23.405520 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.405483 2572 generic.go:356] "Generic (PLEG): container finished" podID="d74eaa60-c56e-4eec-9ac8-25e8b064332f" containerID="bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e" exitCode=0 Jul 11 03:50:23.405716 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.405535 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d45d96b-jnjt6" Jul 11 03:50:23.405716 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.405565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d45d96b-jnjt6" event={"ID":"d74eaa60-c56e-4eec-9ac8-25e8b064332f","Type":"ContainerDied","Data":"bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e"} Jul 11 03:50:23.405716 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.405617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d45d96b-jnjt6" event={"ID":"d74eaa60-c56e-4eec-9ac8-25e8b064332f","Type":"ContainerDied","Data":"a12e6955a7be72ae9df54087cf6ef124205cdd61748b2136c16f8cbcbdfd6fc8"} Jul 11 03:50:23.405716 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.405637 2572 scope.go:117] "RemoveContainer" containerID="bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e" Jul 11 03:50:23.415173 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.415156 2572 scope.go:117] "RemoveContainer" containerID="bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e" Jul 11 03:50:23.415459 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:50:23.415442 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e\": container with ID starting with bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e not found: ID does not exist" containerID="bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e" Jul 11 03:50:23.415509 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.415467 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e"} err="failed to get container status \"bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e\": rpc error: code = NotFound desc = could not find container \"bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e\": container with ID starting with bd04163275c85c5d7818f073176df24ad4b238b10507cfcf8d0eac07311a259e not found: ID does not exist" Jul 11 03:50:23.425818 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.425783 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-664d45d96b-jnjt6"] Jul 11 03:50:23.429572 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.429552 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-664d45d96b-jnjt6"] Jul 11 03:50:23.835957 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:23.835883 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74eaa60-c56e-4eec-9ac8-25e8b064332f" path="/var/lib/kubelet/pods/d74eaa60-c56e-4eec-9ac8-25e8b064332f/volumes" Jul 11 03:50:38.077965 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.077934 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gmvl8"] Jul 11 03:50:38.078409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.078321 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" containerName="authorino" Jul 11 03:50:38.078409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.078332 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" containerName="authorino" Jul 11 03:50:38.078409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.078343 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74eaa60-c56e-4eec-9ac8-25e8b064332f" containerName="console" Jul 11 03:50:38.078409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.078349 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74eaa60-c56e-4eec-9ac8-25e8b064332f" containerName="console" Jul 11 03:50:38.078409 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.078412 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74eaa60-c56e-4eec-9ac8-25e8b064332f" containerName="console" Jul 11 03:50:38.078563 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.078419 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="889e2e3f-98ff-48d7-a060-3a0ca0e3b5ff" containerName="authorino" Jul 11 03:50:38.083085 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.083063 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:38.087516 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.087491 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gmvl8"] Jul 11 03:50:38.170220 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.170188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9cg\" (UniqueName: \"kubernetes.io/projected/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5-kube-api-access-mg9cg\") pod \"authorino-5d4b67c446-gmvl8\" (UID: \"7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5\") " pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:38.271059 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.271023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9cg\" (UniqueName: \"kubernetes.io/projected/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5-kube-api-access-mg9cg\") pod \"authorino-5d4b67c446-gmvl8\" (UID: \"7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5\") " pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:38.281407 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.281377 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gmvl8"] Jul 11 03:50:38.281627 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:50:38.281610 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mg9cg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-gmvl8" podUID="7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5" Jul 11 03:50:38.283813 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.283795 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9cg\" (UniqueName: \"kubernetes.io/projected/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5-kube-api-access-mg9cg\") pod \"authorino-5d4b67c446-gmvl8\" (UID: \"7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5\") " pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:38.305524 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.305501 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68854b59d7-dhdw9"] Jul 11 03:50:38.308946 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.308931 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.310938 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.310913 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 11 03:50:38.317242 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.317221 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68854b59d7-dhdw9"] Jul 11 03:50:38.473135 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.473101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c9b781-fec9-45f8-8021-fb9bd8300199-tls-cert\") pod \"authorino-68854b59d7-dhdw9\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.473301 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.473149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcgv\" (UniqueName: \"kubernetes.io/projected/65c9b781-fec9-45f8-8021-fb9bd8300199-kube-api-access-jzcgv\") pod \"authorino-68854b59d7-dhdw9\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.482706 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.482680 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:38.489512 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.489488 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:38.574219 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.574193 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg9cg\" (UniqueName: \"kubernetes.io/projected/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5-kube-api-access-mg9cg\") pod \"7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5\" (UID: \"7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5\") " Jul 11 03:50:38.574390 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.574371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c9b781-fec9-45f8-8021-fb9bd8300199-tls-cert\") pod \"authorino-68854b59d7-dhdw9\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.574442 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.574427 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcgv\" (UniqueName: \"kubernetes.io/projected/65c9b781-fec9-45f8-8021-fb9bd8300199-kube-api-access-jzcgv\") pod \"authorino-68854b59d7-dhdw9\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.576418 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.576395 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5-kube-api-access-mg9cg" (OuterVolumeSpecName: "kube-api-access-mg9cg") pod "7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5" (UID: "7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5"). InnerVolumeSpecName "kube-api-access-mg9cg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:50:38.576809 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.576794 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c9b781-fec9-45f8-8021-fb9bd8300199-tls-cert\") pod \"authorino-68854b59d7-dhdw9\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.581149 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.581128 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcgv\" (UniqueName: \"kubernetes.io/projected/65c9b781-fec9-45f8-8021-fb9bd8300199-kube-api-access-jzcgv\") pod \"authorino-68854b59d7-dhdw9\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.619164 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.619137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:50:38.675295 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.675253 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg9cg\" (UniqueName: \"kubernetes.io/projected/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5-kube-api-access-mg9cg\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:38.749199 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:38.749174 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68854b59d7-dhdw9"] Jul 11 03:50:38.751314 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:50:38.751286 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c9b781_fec9_45f8_8021_fb9bd8300199.slice/crio-2b29ad22d458983fb19d3bb0ab15775a391d04112bb898a809fa199ea11362dc WatchSource:0}: Error finding container 2b29ad22d458983fb19d3bb0ab15775a391d04112bb898a809fa199ea11362dc: Status 404 returned error can't find the container with id 2b29ad22d458983fb19d3bb0ab15775a391d04112bb898a809fa199ea11362dc Jul 11 03:50:39.488899 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.488776 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68854b59d7-dhdw9" event={"ID":"65c9b781-fec9-45f8-8021-fb9bd8300199","Type":"ContainerStarted","Data":"f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d"} Jul 11 03:50:39.488899 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.488822 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68854b59d7-dhdw9" event={"ID":"65c9b781-fec9-45f8-8021-fb9bd8300199","Type":"ContainerStarted","Data":"2b29ad22d458983fb19d3bb0ab15775a391d04112bb898a809fa199ea11362dc"} Jul 11 03:50:39.488899 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.488793 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gmvl8" Jul 11 03:50:39.504261 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.504216 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68854b59d7-dhdw9" podStartSLOduration=1.135842023 podStartE2EDuration="1.504202297s" totalImagesPullingTime="368.360274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:50:39.502342715 +0000 UTC m=+470.219680953" watchObservedRunningTime="2026-07-11 03:50:39.504202297 +0000 UTC m=+470.221540524" Jul 11 03:50:39.526553 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.526517 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gmvl8"] Jul 11 03:50:39.531567 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.531538 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gmvl8"] Jul 11 03:50:39.533578 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.533555 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c66g5"] Jul 11 03:50:39.533787 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.533755 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-c66g5" podUID="2c7dbdb7-40c1-4d44-8252-46090a6a2452" containerName="authorino" containerID="cri-o://0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929" gracePeriod=30 Jul 11 03:50:39.787466 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.787445 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:39.836869 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.836815 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5" path="/var/lib/kubelet/pods/7ab9dae7-e8d3-48b8-bec8-6bc07ccf82c5/volumes" Jul 11 03:50:39.885476 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.885444 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fpwq\" (UniqueName: \"kubernetes.io/projected/2c7dbdb7-40c1-4d44-8252-46090a6a2452-kube-api-access-4fpwq\") pod \"2c7dbdb7-40c1-4d44-8252-46090a6a2452\" (UID: \"2c7dbdb7-40c1-4d44-8252-46090a6a2452\") " Jul 11 03:50:39.887967 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.887945 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c7dbdb7-40c1-4d44-8252-46090a6a2452-kube-api-access-4fpwq" (OuterVolumeSpecName: "kube-api-access-4fpwq") pod "2c7dbdb7-40c1-4d44-8252-46090a6a2452" (UID: "2c7dbdb7-40c1-4d44-8252-46090a6a2452"). InnerVolumeSpecName "kube-api-access-4fpwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:50:39.986877 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:39.986808 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fpwq\" (UniqueName: \"kubernetes.io/projected/2c7dbdb7-40c1-4d44-8252-46090a6a2452-kube-api-access-4fpwq\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:50:40.494763 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.494724 2572 generic.go:356] "Generic (PLEG): container finished" podID="2c7dbdb7-40c1-4d44-8252-46090a6a2452" containerID="0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929" exitCode=0 Jul 11 03:50:40.495190 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.494785 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c66g5" Jul 11 03:50:40.495190 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.494818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c66g5" event={"ID":"2c7dbdb7-40c1-4d44-8252-46090a6a2452","Type":"ContainerDied","Data":"0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929"} Jul 11 03:50:40.495190 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.494889 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c66g5" event={"ID":"2c7dbdb7-40c1-4d44-8252-46090a6a2452","Type":"ContainerDied","Data":"556e4ac5cd8ebd7a78dc95558a9539cf3be089e853b26788b19e9a5bcec74a0b"} Jul 11 03:50:40.495190 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.494909 2572 scope.go:117] "RemoveContainer" containerID="0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929" Jul 11 03:50:40.504085 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.504070 2572 scope.go:117] "RemoveContainer" containerID="0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929" Jul 11 03:50:40.504349 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:50:40.504330 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929\": container with ID starting with 0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929 not found: ID does not exist" containerID="0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929" Jul 11 03:50:40.504391 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.504356 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929"} err="failed to get container status \"0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929\": rpc error: code = NotFound desc = could not find container \"0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929\": container with ID starting with 0c2aa527a78a9030a6ed1a95c85f70441a2e19596308e52deeb148073ade1929 not found: ID does not exist" Jul 11 03:50:40.514937 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.514912 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c66g5"] Jul 11 03:50:40.516862 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:40.516823 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c66g5"] Jul 11 03:50:41.835663 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:50:41.835620 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c7dbdb7-40c1-4d44-8252-46090a6a2452" path="/var/lib/kubelet/pods/2c7dbdb7-40c1-4d44-8252-46090a6a2452/volumes" Jul 11 03:52:20.316569 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.316536 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2"] Jul 11 03:52:20.317113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.316915 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c7dbdb7-40c1-4d44-8252-46090a6a2452" containerName="authorino" Jul 11 03:52:20.317113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.316930 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c7dbdb7-40c1-4d44-8252-46090a6a2452" containerName="authorino" Jul 11 03:52:20.317113 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.317010 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c7dbdb7-40c1-4d44-8252-46090a6a2452" containerName="authorino" Jul 11 03:52:20.320005 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.319987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.322169 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.322150 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 11 03:52:20.322276 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.322250 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 11 03:52:20.322276 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.322256 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lvfkx\"" Jul 11 03:52:20.322375 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.322250 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 11 03:52:20.327648 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.327616 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2"] Jul 11 03:52:20.458165 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.458127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac61dba5-4bc8-44d5-bdf3-83547acba347-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.458343 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.458185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.458343 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.458233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.458343 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.458269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.458343 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.458314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpmf5\" (UniqueName: \"kubernetes.io/projected/ac61dba5-4bc8-44d5-bdf3-83547acba347-kube-api-access-jpmf5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.458475 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.458362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.559823 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.559775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac61dba5-4bc8-44d5-bdf3-83547acba347-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560022 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.559860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560022 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.559876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560022 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.559897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560022 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.559935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpmf5\" (UniqueName: \"kubernetes.io/projected/ac61dba5-4bc8-44d5-bdf3-83547acba347-kube-api-access-jpmf5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560022 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.559966 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560382 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.560359 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.560386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.560448 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.560407 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.562274 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.562250 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac61dba5-4bc8-44d5-bdf3-83547acba347-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.562424 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.562407 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac61dba5-4bc8-44d5-bdf3-83547acba347-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.567243 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.567188 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpmf5\" (UniqueName: \"kubernetes.io/projected/ac61dba5-4bc8-44d5-bdf3-83547acba347-kube-api-access-jpmf5\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vvjr2\" (UID: \"ac61dba5-4bc8-44d5-bdf3-83547acba347\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.630375 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.630341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:20.777564 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:20.777539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2"] Jul 11 03:52:20.779590 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:52:20.779562 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac61dba5_4bc8_44d5_bdf3_83547acba347.slice/crio-bb09f21acc7713a4c1c5056d44884c00d72510f22e0ee7971355ee9b11f67a45 WatchSource:0}: Error finding container bb09f21acc7713a4c1c5056d44884c00d72510f22e0ee7971355ee9b11f67a45: Status 404 returned error can't find the container with id bb09f21acc7713a4c1c5056d44884c00d72510f22e0ee7971355ee9b11f67a45 Jul 11 03:52:21.022632 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:21.022592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" event={"ID":"ac61dba5-4bc8-44d5-bdf3-83547acba347","Type":"ContainerStarted","Data":"bb09f21acc7713a4c1c5056d44884c00d72510f22e0ee7971355ee9b11f67a45"} Jul 11 03:52:22.030918 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:22.030876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" event={"ID":"ac61dba5-4bc8-44d5-bdf3-83547acba347","Type":"ContainerStarted","Data":"cd20a5146123432c06f23dd01b822306205c02f9b2f47fd217de806174a97e43"} Jul 11 03:52:22.049780 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:22.049731 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" podStartSLOduration=1.006504248 podStartE2EDuration="2.049690289s" totalImagesPullingTime="1.043186041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:22.049200405 +0000 UTC m=+572.766538643" watchObservedRunningTime="2026-07-11 03:52:22.049690289 +0000 UTC m=+572.767028527" Jul 11 03:52:30.630663 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:30.630624 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:30.631166 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:30.630705 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:30.643254 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:30.643234 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:31.090049 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:31.089963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vvjr2" Jul 11 03:52:37.201806 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.201774 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb"] Jul 11 03:52:37.208653 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.208627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.210962 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.210941 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 11 03:52:37.215525 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.215503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb"] Jul 11 03:52:37.310201 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.310166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.310201 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.310207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.310418 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.310238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz625\" (UniqueName: \"kubernetes.io/projected/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-kube-api-access-wz625\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.310418 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.310294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.310418 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.310314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.310418 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.310342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.411765 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.411731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.411765 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.411773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412012 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.411799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz625\" (UniqueName: \"kubernetes.io/projected/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-kube-api-access-wz625\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412012 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.411824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412012 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.411856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412012 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.411886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412298 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.412274 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412298 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.412284 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.412399 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.412350 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.414133 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.414112 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.414377 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.414361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.419480 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.419463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz625\" (UniqueName: \"kubernetes.io/projected/c098f4e2-0b9e-4f38-bf69-a0fc5989bc56-kube-api-access-wz625\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-trxjb\" (UID: \"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.520802 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.520715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:37.651602 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:37.651577 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb"] Jul 11 03:52:37.653003 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:52:37.652976 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc098f4e2_0b9e_4f38_bf69_a0fc5989bc56.slice/crio-a4f2c961b52eca601c09b0a95fa2ebf93fac8b1fcf4bb66fccb4b2acd0e2af03 WatchSource:0}: Error finding container a4f2c961b52eca601c09b0a95fa2ebf93fac8b1fcf4bb66fccb4b2acd0e2af03: Status 404 returned error can't find the container with id a4f2c961b52eca601c09b0a95fa2ebf93fac8b1fcf4bb66fccb4b2acd0e2af03 Jul 11 03:52:38.120821 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:38.120780 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" event={"ID":"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56","Type":"ContainerStarted","Data":"9e9e86f0642a1322a963a1b69ee773fa88c93bb4f058612fff3b97c674065b39"} Jul 11 03:52:38.121009 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:38.120870 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" event={"ID":"c098f4e2-0b9e-4f38-bf69-a0fc5989bc56","Type":"ContainerStarted","Data":"a4f2c961b52eca601c09b0a95fa2ebf93fac8b1fcf4bb66fccb4b2acd0e2af03"} Jul 11 03:52:38.137972 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:38.137926 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" podStartSLOduration=0.972605338 podStartE2EDuration="1.137911185s" totalImagesPullingTime="165.305847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:52:38.137253159 +0000 UTC m=+588.854591400" watchObservedRunningTime="2026-07-11 03:52:38.137911185 +0000 UTC m=+588.855249430" Jul 11 03:52:47.521683 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:47.521648 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:47.522164 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:47.521735 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:47.534450 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:47.534426 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:52:48.183654 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:52:48.183623 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-trxjb" Jul 11 03:53:53.405065 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.405028 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc49c57b6-6lwgx"] Jul 11 03:53:53.408614 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.408594 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.415662 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.415635 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc49c57b6-6lwgx"] Jul 11 03:53:53.496093 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.496066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80da3d46-5d62-4c6e-aedc-887bb063f7a8-tls-cert\") pod \"authorino-5dc49c57b6-6lwgx\" (UID: \"80da3d46-5d62-4c6e-aedc-887bb063f7a8\") " pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.496263 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.496106 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vskrs\" (UniqueName: \"kubernetes.io/projected/80da3d46-5d62-4c6e-aedc-887bb063f7a8-kube-api-access-vskrs\") pod \"authorino-5dc49c57b6-6lwgx\" (UID: \"80da3d46-5d62-4c6e-aedc-887bb063f7a8\") " pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.597074 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.597042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80da3d46-5d62-4c6e-aedc-887bb063f7a8-tls-cert\") pod \"authorino-5dc49c57b6-6lwgx\" (UID: \"80da3d46-5d62-4c6e-aedc-887bb063f7a8\") " pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.597236 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.597082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vskrs\" (UniqueName: \"kubernetes.io/projected/80da3d46-5d62-4c6e-aedc-887bb063f7a8-kube-api-access-vskrs\") pod \"authorino-5dc49c57b6-6lwgx\" (UID: \"80da3d46-5d62-4c6e-aedc-887bb063f7a8\") " pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.599668 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.599639 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80da3d46-5d62-4c6e-aedc-887bb063f7a8-tls-cert\") pod \"authorino-5dc49c57b6-6lwgx\" (UID: \"80da3d46-5d62-4c6e-aedc-887bb063f7a8\") " pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.604170 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.604145 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vskrs\" (UniqueName: \"kubernetes.io/projected/80da3d46-5d62-4c6e-aedc-887bb063f7a8-kube-api-access-vskrs\") pod \"authorino-5dc49c57b6-6lwgx\" (UID: \"80da3d46-5d62-4c6e-aedc-887bb063f7a8\") " pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.719760 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.719682 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" Jul 11 03:53:53.851783 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.851759 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc49c57b6-6lwgx"] Jul 11 03:53:53.853690 ip-10-0-142-101 kubenswrapper[2572]: W0711 03:53:53.853663 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80da3d46_5d62_4c6e_aedc_887bb063f7a8.slice/crio-068e3ff6986e5248f37617261bf23f697d745987a3e53e20e87ad23a64563d50 WatchSource:0}: Error finding container 068e3ff6986e5248f37617261bf23f697d745987a3e53e20e87ad23a64563d50: Status 404 returned error can't find the container with id 068e3ff6986e5248f37617261bf23f697d745987a3e53e20e87ad23a64563d50 Jul 11 03:53:53.855005 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:53.854987 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 03:53:54.525823 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:54.525720 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" event={"ID":"80da3d46-5d62-4c6e-aedc-887bb063f7a8","Type":"ContainerStarted","Data":"b127eaadf88651cbefe4366ccee3873a9594a8df821f80b6158843381b087ce9"} Jul 11 03:53:54.525823 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:54.525777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" event={"ID":"80da3d46-5d62-4c6e-aedc-887bb063f7a8","Type":"ContainerStarted","Data":"068e3ff6986e5248f37617261bf23f697d745987a3e53e20e87ad23a64563d50"} Jul 11 03:53:54.541577 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:54.541513 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc49c57b6-6lwgx" podStartSLOduration=1.122656847 podStartE2EDuration="1.541490264s" totalImagesPullingTime="418.833417ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 03:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 03:53:54.54126183 +0000 UTC m=+665.258600066" watchObservedRunningTime="2026-07-11 03:53:54.541490264 +0000 UTC m=+665.258828503" Jul 11 03:53:54.570722 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:54.570672 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68854b59d7-dhdw9"] Jul 11 03:53:54.571733 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:54.571346 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-68854b59d7-dhdw9" podUID="65c9b781-fec9-45f8-8021-fb9bd8300199" containerName="authorino" containerID="cri-o://f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d" gracePeriod=30 Jul 11 03:53:54.848646 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:54.848622 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:53:55.011093 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.011054 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzcgv\" (UniqueName: \"kubernetes.io/projected/65c9b781-fec9-45f8-8021-fb9bd8300199-kube-api-access-jzcgv\") pod \"65c9b781-fec9-45f8-8021-fb9bd8300199\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " Jul 11 03:53:55.011284 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.011121 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c9b781-fec9-45f8-8021-fb9bd8300199-tls-cert\") pod \"65c9b781-fec9-45f8-8021-fb9bd8300199\" (UID: \"65c9b781-fec9-45f8-8021-fb9bd8300199\") " Jul 11 03:53:55.013783 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.013750 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c9b781-fec9-45f8-8021-fb9bd8300199-kube-api-access-jzcgv" (OuterVolumeSpecName: "kube-api-access-jzcgv") pod "65c9b781-fec9-45f8-8021-fb9bd8300199" (UID: "65c9b781-fec9-45f8-8021-fb9bd8300199"). InnerVolumeSpecName "kube-api-access-jzcgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 03:53:55.025616 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.025583 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65c9b781-fec9-45f8-8021-fb9bd8300199-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "65c9b781-fec9-45f8-8021-fb9bd8300199" (UID: "65c9b781-fec9-45f8-8021-fb9bd8300199"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 03:53:55.113018 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.112978 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzcgv\" (UniqueName: \"kubernetes.io/projected/65c9b781-fec9-45f8-8021-fb9bd8300199-kube-api-access-jzcgv\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:53:55.113018 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.113012 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c9b781-fec9-45f8-8021-fb9bd8300199-tls-cert\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 03:53:55.532714 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.532614 2572 generic.go:356] "Generic (PLEG): container finished" podID="65c9b781-fec9-45f8-8021-fb9bd8300199" containerID="f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d" exitCode=0 Jul 11 03:53:55.532714 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.532663 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68854b59d7-dhdw9" Jul 11 03:53:55.532714 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.532680 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68854b59d7-dhdw9" event={"ID":"65c9b781-fec9-45f8-8021-fb9bd8300199","Type":"ContainerDied","Data":"f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d"} Jul 11 03:53:55.533309 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.532727 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68854b59d7-dhdw9" event={"ID":"65c9b781-fec9-45f8-8021-fb9bd8300199","Type":"ContainerDied","Data":"2b29ad22d458983fb19d3bb0ab15775a391d04112bb898a809fa199ea11362dc"} Jul 11 03:53:55.533309 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.532744 2572 scope.go:117] "RemoveContainer" containerID="f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d" Jul 11 03:53:55.543325 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.543302 2572 scope.go:117] "RemoveContainer" containerID="f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d" Jul 11 03:53:55.543618 ip-10-0-142-101 kubenswrapper[2572]: E0711 03:53:55.543597 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d\": container with ID starting with f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d not found: ID does not exist" containerID="f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d" Jul 11 03:53:55.543688 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.543631 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d"} err="failed to get container status \"f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d\": rpc error: code = NotFound desc = could not find container \"f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d\": container with ID starting with f20576041d45ad85a8ee4e1236f25d78516945d46c31cbbf46467e4812b2996d not found: ID does not exist" Jul 11 03:53:55.555931 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.555903 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68854b59d7-dhdw9"] Jul 11 03:53:55.561543 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.561519 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68854b59d7-dhdw9"] Jul 11 03:53:55.836473 ip-10-0-142-101 kubenswrapper[2572]: I0711 03:53:55.836386 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c9b781-fec9-45f8-8021-fb9bd8300199" path="/var/lib/kubelet/pods/65c9b781-fec9-45f8-8021-fb9bd8300199/volumes" Jul 11 04:24:41.306408 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.306328 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s"] Jul 11 04:24:41.308675 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.306749 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c9b781-fec9-45f8-8021-fb9bd8300199" containerName="authorino" Jul 11 04:24:41.308675 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.306761 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c9b781-fec9-45f8-8021-fb9bd8300199" containerName="authorino" Jul 11 04:24:41.308675 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.306820 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c9b781-fec9-45f8-8021-fb9bd8300199" containerName="authorino" Jul 11 04:24:41.309523 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.309508 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.312536 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.312514 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6ee78d\"/\"openshift-service-ca.crt\"" Jul 11 04:24:41.312536 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.312527 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6ee78d\"/\"sub-test-model-6ee78d-kserve-self-signed-certs\"" Jul 11 04:24:41.312712 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.312541 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6ee78d\"/\"kube-root-ca.crt\"" Jul 11 04:24:41.312712 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.312630 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6ee78d\"/\"default-dockercfg-2dzlv\"" Jul 11 04:24:41.317497 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.317475 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s"] Jul 11 04:24:41.470661 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.470621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmchp\" (UniqueName: \"kubernetes.io/projected/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-kube-api-access-wmchp\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.470661 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.470665 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tls-certs\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.470963 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.470693 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-model-cache\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.470963 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.470768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-home\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.470963 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.470804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-dshm\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.470963 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.470915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tmp-dir\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572063 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.571965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmchp\" (UniqueName: \"kubernetes.io/projected/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-kube-api-access-wmchp\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572063 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tls-certs\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572302 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-model-cache\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572302 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572213 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-home\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572302 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-dshm\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572302 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tmp-dir\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572592 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572559 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-model-cache\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572709 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572568 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-home\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.572709 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.572636 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tmp-dir\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.574578 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.574557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-dshm\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.574709 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.574695 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tls-certs\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.579490 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.579472 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmchp\" (UniqueName: \"kubernetes.io/projected/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-kube-api-access-wmchp\") pod \"sub-test-model-6ee78d-kserve-579db64577-dzn9s\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.619345 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.619313 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:41.753413 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:41.753378 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s"] Jul 11 04:24:41.754719 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:24:41.754692 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6289c1b8_e4b8_4de5_af25_38a6b114f0a5.slice/crio-8efbe7cd9b361108548d74bbca5fc29e41d18038b4df1bf6cda8059879280413 WatchSource:0}: Error finding container 8efbe7cd9b361108548d74bbca5fc29e41d18038b4df1bf6cda8059879280413: Status 404 returned error can't find the container with id 8efbe7cd9b361108548d74bbca5fc29e41d18038b4df1bf6cda8059879280413 Jul 11 04:24:42.274335 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:42.274246 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" event={"ID":"6289c1b8-e4b8-4de5-af25-38a6b114f0a5","Type":"ContainerStarted","Data":"8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7"} Jul 11 04:24:42.274335 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:42.274297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" event={"ID":"6289c1b8-e4b8-4de5-af25-38a6b114f0a5","Type":"ContainerStarted","Data":"8efbe7cd9b361108548d74bbca5fc29e41d18038b4df1bf6cda8059879280413"} Jul 11 04:24:42.289609 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:42.289558 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" podStartSLOduration=1.289543053 podStartE2EDuration="1.289543053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:24:42.288684093 +0000 UTC m=+2513.006022332" watchObservedRunningTime="2026-07-11 04:24:42.289543053 +0000 UTC m=+2513.006881349" Jul 11 04:24:51.619803 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:51.619756 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:51.620286 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:51.619853 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:51.632690 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:51.632662 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:24:52.344655 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:24:52.344625 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:25:45.693002 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:25:45.692970 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s"] Jul 11 04:26:00.713833 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:00.713793 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" podUID="6289c1b8-e4b8-4de5-af25-38a6b114f0a5" containerName="main" containerID="cri-o://8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7" gracePeriod=45 Jul 11 04:26:00.953969 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:00.953945 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:26:01.097934 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.097828 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-model-cache\") pod \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " Jul 11 04:26:01.097934 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.097888 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tls-certs\") pod \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " Jul 11 04:26:01.097934 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.097922 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-home\") pod \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " Jul 11 04:26:01.098203 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098008 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmchp\" (UniqueName: \"kubernetes.io/projected/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-kube-api-access-wmchp\") pod \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " Jul 11 04:26:01.098203 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098032 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-dshm\") pod \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " Jul 11 04:26:01.098203 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098063 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tmp-dir\") pod \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\" (UID: \"6289c1b8-e4b8-4de5-af25-38a6b114f0a5\") " Jul 11 04:26:01.098203 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098149 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-model-cache" (OuterVolumeSpecName: "model-cache") pod "6289c1b8-e4b8-4de5-af25-38a6b114f0a5" (UID: "6289c1b8-e4b8-4de5-af25-38a6b114f0a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:26:01.098203 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098163 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-home" (OuterVolumeSpecName: "home") pod "6289c1b8-e4b8-4de5-af25-38a6b114f0a5" (UID: "6289c1b8-e4b8-4de5-af25-38a6b114f0a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:26:01.098463 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098331 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-model-cache\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:26:01.098463 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098350 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-home\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:26:01.098463 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.098347 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6289c1b8-e4b8-4de5-af25-38a6b114f0a5" (UID: "6289c1b8-e4b8-4de5-af25-38a6b114f0a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:26:01.100373 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.100346 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6289c1b8-e4b8-4de5-af25-38a6b114f0a5" (UID: "6289c1b8-e4b8-4de5-af25-38a6b114f0a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 04:26:01.100373 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.100350 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-dshm" (OuterVolumeSpecName: "dshm") pod "6289c1b8-e4b8-4de5-af25-38a6b114f0a5" (UID: "6289c1b8-e4b8-4de5-af25-38a6b114f0a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:26:01.100518 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.100420 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-kube-api-access-wmchp" (OuterVolumeSpecName: "kube-api-access-wmchp") pod "6289c1b8-e4b8-4de5-af25-38a6b114f0a5" (UID: "6289c1b8-e4b8-4de5-af25-38a6b114f0a5"). InnerVolumeSpecName "kube-api-access-wmchp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:26:01.199497 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.199466 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmchp\" (UniqueName: \"kubernetes.io/projected/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-kube-api-access-wmchp\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:26:01.199497 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.199493 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-dshm\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:26:01.199497 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.199504 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tmp-dir\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:26:01.199731 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.199514 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6289c1b8-e4b8-4de5-af25-38a6b114f0a5-tls-certs\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:26:01.221360 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.221327 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g"] Jul 11 04:26:01.221706 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.221695 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6289c1b8-e4b8-4de5-af25-38a6b114f0a5" containerName="main" Jul 11 04:26:01.221750 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.221708 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6289c1b8-e4b8-4de5-af25-38a6b114f0a5" containerName="main" Jul 11 04:26:01.221784 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.221775 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6289c1b8-e4b8-4de5-af25-38a6b114f0a5" containerName="main" Jul 11 04:26:01.224893 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.224876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.227099 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.227082 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6ee78d\"/\"rate-test-model-6ee78d-kserve-self-signed-certs\"" Jul 11 04:26:01.232554 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.232531 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g"] Jul 11 04:26:01.300648 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.300614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tmp-dir\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.300822 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.300660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-home\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.300822 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.300716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tls-certs\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.300822 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.300799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-dshm\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.301040 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.300870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-model-cache\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.301040 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.300913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7rj\" (UniqueName: \"kubernetes.io/projected/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-kube-api-access-2n7rj\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.401941 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.401904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-model-cache\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402124 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.401950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7rj\" (UniqueName: \"kubernetes.io/projected/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-kube-api-access-2n7rj\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402124 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.401972 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tmp-dir\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402204 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.402150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-home\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402250 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.402204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tls-certs\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402304 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.402286 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tmp-dir\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402356 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.402301 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-dshm\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402413 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.402359 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-model-cache\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.402466 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.402426 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-home\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.404556 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.404536 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-dshm\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.404894 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.404860 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tls-certs\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.409319 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.409297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7rj\" (UniqueName: \"kubernetes.io/projected/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-kube-api-access-2n7rj\") pod \"rate-test-model-6ee78d-kserve-6464498ddc-5pm6g\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.535204 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.535174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:01.672008 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.671983 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g"] Jul 11 04:26:01.673075 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:26:01.673051 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b3df2cc_1a48_4ad7_8215_d865d6c3f03e.slice/crio-1b3a546db4ef27bbc67cd6b0f58db0b1513ad068c9c9cc31b92473ee32061bc2 WatchSource:0}: Error finding container 1b3a546db4ef27bbc67cd6b0f58db0b1513ad068c9c9cc31b92473ee32061bc2: Status 404 returned error can't find the container with id 1b3a546db4ef27bbc67cd6b0f58db0b1513ad068c9c9cc31b92473ee32061bc2 Jul 11 04:26:01.705990 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.705957 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" event={"ID":"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e","Type":"ContainerStarted","Data":"1b3a546db4ef27bbc67cd6b0f58db0b1513ad068c9c9cc31b92473ee32061bc2"} Jul 11 04:26:01.707137 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.707109 2572 generic.go:356] "Generic (PLEG): container finished" podID="6289c1b8-e4b8-4de5-af25-38a6b114f0a5" containerID="8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7" exitCode=0 Jul 11 04:26:01.707278 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.707161 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" event={"ID":"6289c1b8-e4b8-4de5-af25-38a6b114f0a5","Type":"ContainerDied","Data":"8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7"} Jul 11 04:26:01.707278 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.707215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" event={"ID":"6289c1b8-e4b8-4de5-af25-38a6b114f0a5","Type":"ContainerDied","Data":"8efbe7cd9b361108548d74bbca5fc29e41d18038b4df1bf6cda8059879280413"} Jul 11 04:26:01.707278 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.707242 2572 scope.go:117] "RemoveContainer" containerID="8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7" Jul 11 04:26:01.707278 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.707175 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s" Jul 11 04:26:01.717313 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.717112 2572 scope.go:117] "RemoveContainer" containerID="8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7" Jul 11 04:26:01.717644 ip-10-0-142-101 kubenswrapper[2572]: E0711 04:26:01.717396 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7\": container with ID starting with 8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7 not found: ID does not exist" containerID="8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7" Jul 11 04:26:01.717644 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.717425 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7"} err="failed to get container status \"8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7\": rpc error: code = NotFound desc = could not find container \"8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7\": container with ID starting with 8ca4e91828743a5cb1f02b8db6c73d7a585e762849057df80c69b0191299e7e7 not found: ID does not exist" Jul 11 04:26:01.760550 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.760512 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s"] Jul 11 04:26:01.762687 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.762651 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/sub-test-model-6ee78d-kserve-579db64577-dzn9s"] Jul 11 04:26:01.837607 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:01.837573 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6289c1b8-e4b8-4de5-af25-38a6b114f0a5" path="/var/lib/kubelet/pods/6289c1b8-e4b8-4de5-af25-38a6b114f0a5/volumes" Jul 11 04:26:02.715211 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:02.715177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" event={"ID":"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e","Type":"ContainerStarted","Data":"d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9"} Jul 11 04:26:02.731953 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:02.731898 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" podStartSLOduration=1.7318757790000001 podStartE2EDuration="1.731875779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:26:02.730557806 +0000 UTC m=+2593.447896043" watchObservedRunningTime="2026-07-11 04:26:02.731875779 +0000 UTC m=+2593.449214017" Jul 11 04:26:11.535434 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:11.535349 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:11.535434 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:11.535412 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:11.547885 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:11.547828 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:26:11.777471 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:26:11.777441 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:27:14.924103 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:14.924069 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g"] Jul 11 04:27:16.786535 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:16.786497 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7242-139751910497328"] Jul 11 04:27:16.790100 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:16.790081 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:16.792825 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:16.792800 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-g7fmf\"" Jul 11 04:27:16.795102 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:16.795079 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751910497328"] Jul 11 04:27:16.979918 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:16.979875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfqj9\" (UniqueName: \"kubernetes.io/projected/c00f674c-89cc-4d02-9ae8-2068c37f5579-kube-api-access-xfqj9\") pod \"test-curl-7242-139751910497328\" (UID: \"c00f674c-89cc-4d02-9ae8-2068c37f5579\") " pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:17.080537 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:17.080433 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfqj9\" (UniqueName: \"kubernetes.io/projected/c00f674c-89cc-4d02-9ae8-2068c37f5579-kube-api-access-xfqj9\") pod \"test-curl-7242-139751910497328\" (UID: \"c00f674c-89cc-4d02-9ae8-2068c37f5579\") " pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:17.088368 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:17.088347 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfqj9\" (UniqueName: \"kubernetes.io/projected/c00f674c-89cc-4d02-9ae8-2068c37f5579-kube-api-access-xfqj9\") pod \"test-curl-7242-139751910497328\" (UID: \"c00f674c-89cc-4d02-9ae8-2068c37f5579\") " pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:17.100234 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:17.100210 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:17.233590 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:17.233558 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751910497328"] Jul 11 04:27:17.235123 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:27:17.235099 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc00f674c_89cc_4d02_9ae8_2068c37f5579.slice/crio-60731bb007e144853ebe47eb1025218001ea3daab0c3563bf228d7a5bf63f2ed WatchSource:0}: Error finding container 60731bb007e144853ebe47eb1025218001ea3daab0c3563bf228d7a5bf63f2ed: Status 404 returned error can't find the container with id 60731bb007e144853ebe47eb1025218001ea3daab0c3563bf228d7a5bf63f2ed Jul 11 04:27:17.236440 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:17.236423 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 04:27:18.119918 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:18.119877 2572 generic.go:356] "Generic (PLEG): container finished" podID="c00f674c-89cc-4d02-9ae8-2068c37f5579" containerID="1161ea6127419bdc6d3fcacd4974425070c2f8a0bf3ea1aae60a523d534a32f8" exitCode=0 Jul 11 04:27:18.120295 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:18.119952 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751910497328" event={"ID":"c00f674c-89cc-4d02-9ae8-2068c37f5579","Type":"ContainerDied","Data":"1161ea6127419bdc6d3fcacd4974425070c2f8a0bf3ea1aae60a523d534a32f8"} Jul 11 04:27:18.120295 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:18.119989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751910497328" event={"ID":"c00f674c-89cc-4d02-9ae8-2068c37f5579","Type":"ContainerStarted","Data":"60731bb007e144853ebe47eb1025218001ea3daab0c3563bf228d7a5bf63f2ed"} Jul 11 04:27:19.264310 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.264285 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:19.298277 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.298237 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfqj9\" (UniqueName: \"kubernetes.io/projected/c00f674c-89cc-4d02-9ae8-2068c37f5579-kube-api-access-xfqj9\") pod \"c00f674c-89cc-4d02-9ae8-2068c37f5579\" (UID: \"c00f674c-89cc-4d02-9ae8-2068c37f5579\") " Jul 11 04:27:19.298768 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.298734 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7242-139751910497328_c00f674c-89cc-4d02-9ae8-2068c37f5579/test-curl-7242-139751910497328/0.log" Jul 11 04:27:19.300639 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.300604 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00f674c-89cc-4d02-9ae8-2068c37f5579-kube-api-access-xfqj9" (OuterVolumeSpecName: "kube-api-access-xfqj9") pod "c00f674c-89cc-4d02-9ae8-2068c37f5579" (UID: "c00f674c-89cc-4d02-9ae8-2068c37f5579"). InnerVolumeSpecName "kube-api-access-xfqj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:19.323876 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.323829 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7242-139751910497328"] Jul 11 04:27:19.327797 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.327773 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7242-139751910497328"] Jul 11 04:27:19.399057 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.398968 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfqj9\" (UniqueName: \"kubernetes.io/projected/c00f674c-89cc-4d02-9ae8-2068c37f5579-kube-api-access-xfqj9\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:19.448662 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.448627 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7242-139751907488816"] Jul 11 04:27:19.449021 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.449007 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00f674c-89cc-4d02-9ae8-2068c37f5579" containerName="test-curl-7242-139751910497328" Jul 11 04:27:19.449070 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.449023 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00f674c-89cc-4d02-9ae8-2068c37f5579" containerName="test-curl-7242-139751910497328" Jul 11 04:27:19.449114 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.449104 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00f674c-89cc-4d02-9ae8-2068c37f5579" containerName="test-curl-7242-139751910497328" Jul 11 04:27:19.452098 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.452083 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:19.457740 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.457717 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907488816"] Jul 11 04:27:19.499592 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.499554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs47t\" (UniqueName: \"kubernetes.io/projected/7fd255d4-a546-41bc-b86c-9c03e615657f-kube-api-access-rs47t\") pod \"test-curl-7242-139751907488816\" (UID: \"7fd255d4-a546-41bc-b86c-9c03e615657f\") " pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:19.600597 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.600563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs47t\" (UniqueName: \"kubernetes.io/projected/7fd255d4-a546-41bc-b86c-9c03e615657f-kube-api-access-rs47t\") pod \"test-curl-7242-139751907488816\" (UID: \"7fd255d4-a546-41bc-b86c-9c03e615657f\") " pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:19.608372 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.608337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs47t\" (UniqueName: \"kubernetes.io/projected/7fd255d4-a546-41bc-b86c-9c03e615657f-kube-api-access-rs47t\") pod \"test-curl-7242-139751907488816\" (UID: \"7fd255d4-a546-41bc-b86c-9c03e615657f\") " pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:19.761769 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.761675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:19.837525 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.837491 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00f674c-89cc-4d02-9ae8-2068c37f5579" path="/var/lib/kubelet/pods/c00f674c-89cc-4d02-9ae8-2068c37f5579/volumes" Jul 11 04:27:19.900714 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:19.897752 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907488816"] Jul 11 04:27:20.132308 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:20.132279 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751910497328" Jul 11 04:27:20.132308 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:20.132290 2572 scope.go:117] "RemoveContainer" containerID="1161ea6127419bdc6d3fcacd4974425070c2f8a0bf3ea1aae60a523d534a32f8" Jul 11 04:27:20.133629 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:20.133520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907488816" event={"ID":"7fd255d4-a546-41bc-b86c-9c03e615657f","Type":"ContainerStarted","Data":"65c5a53a5f323b02dc0e5c96144953c715656484e12a09813c70903facb55c6d"} Jul 11 04:27:21.141567 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:21.141528 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fd255d4-a546-41bc-b86c-9c03e615657f" containerID="b631aa3782e05af822e374d3aa61d34340b75dc8ce98e32cea7ba6391a8ce1d0" exitCode=0 Jul 11 04:27:21.141977 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:21.141575 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907488816" event={"ID":"7fd255d4-a546-41bc-b86c-9c03e615657f","Type":"ContainerDied","Data":"b631aa3782e05af822e374d3aa61d34340b75dc8ce98e32cea7ba6391a8ce1d0"} Jul 11 04:27:22.290289 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.290260 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:22.310632 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.310607 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7242-139751907488816_7fd255d4-a546-41bc-b86c-9c03e615657f/test-curl-7242-139751907488816/0.log" Jul 11 04:27:22.318855 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.318821 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs47t\" (UniqueName: \"kubernetes.io/projected/7fd255d4-a546-41bc-b86c-9c03e615657f-kube-api-access-rs47t\") pod \"7fd255d4-a546-41bc-b86c-9c03e615657f\" (UID: \"7fd255d4-a546-41bc-b86c-9c03e615657f\") " Jul 11 04:27:22.321107 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.321075 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd255d4-a546-41bc-b86c-9c03e615657f-kube-api-access-rs47t" (OuterVolumeSpecName: "kube-api-access-rs47t") pod "7fd255d4-a546-41bc-b86c-9c03e615657f" (UID: "7fd255d4-a546-41bc-b86c-9c03e615657f"). InnerVolumeSpecName "kube-api-access-rs47t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:22.332295 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.332270 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7242-139751907488816"] Jul 11 04:27:22.336267 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.336245 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7242-139751907488816"] Jul 11 04:27:22.420100 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.420014 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs47t\" (UniqueName: \"kubernetes.io/projected/7fd255d4-a546-41bc-b86c-9c03e615657f-kube-api-access-rs47t\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:22.516121 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.516079 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:22.516489 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.516475 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd255d4-a546-41bc-b86c-9c03e615657f" containerName="test-curl-7242-139751907488816" Jul 11 04:27:22.516534 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.516501 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd255d4-a546-41bc-b86c-9c03e615657f" containerName="test-curl-7242-139751907488816" Jul 11 04:27:22.516580 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.516570 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd255d4-a546-41bc-b86c-9c03e615657f" containerName="test-curl-7242-139751907488816" Jul 11 04:27:22.519657 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.519641 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:22.520413 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.520382 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67h22\" (UniqueName: \"kubernetes.io/projected/55284a8a-6ec0-4e95-b991-7d3fdbec6c40-kube-api-access-67h22\") pod \"test-curl-7242-139751907565616\" (UID: \"55284a8a-6ec0-4e95-b991-7d3fdbec6c40\") " pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:22.525506 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.525478 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:22.621003 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.620969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67h22\" (UniqueName: \"kubernetes.io/projected/55284a8a-6ec0-4e95-b991-7d3fdbec6c40-kube-api-access-67h22\") pod \"test-curl-7242-139751907565616\" (UID: \"55284a8a-6ec0-4e95-b991-7d3fdbec6c40\") " pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:22.628898 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.628866 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67h22\" (UniqueName: \"kubernetes.io/projected/55284a8a-6ec0-4e95-b991-7d3fdbec6c40-kube-api-access-67h22\") pod \"test-curl-7242-139751907565616\" (UID: \"55284a8a-6ec0-4e95-b991-7d3fdbec6c40\") " pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:22.830300 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.830197 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:22.964132 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:22.964110 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:22.966067 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:27:22.966042 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55284a8a_6ec0_4e95_b991_7d3fdbec6c40.slice/crio-6df9c524120cbd3499f30c8a1b8e08ea7e4bc32721b16ad6dfb6de0da728340e WatchSource:0}: Error finding container 6df9c524120cbd3499f30c8a1b8e08ea7e4bc32721b16ad6dfb6de0da728340e: Status 404 returned error can't find the container with id 6df9c524120cbd3499f30c8a1b8e08ea7e4bc32721b16ad6dfb6de0da728340e Jul 11 04:27:23.153590 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:23.153557 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:23.153590 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:23.153587 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65c5a53a5f323b02dc0e5c96144953c715656484e12a09813c70903facb55c6d" Jul 11 04:27:23.154871 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:23.154830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907565616" event={"ID":"55284a8a-6ec0-4e95-b991-7d3fdbec6c40","Type":"ContainerStarted","Data":"6df9c524120cbd3499f30c8a1b8e08ea7e4bc32721b16ad6dfb6de0da728340e"} Jul 11 04:27:23.164067 ip-10-0-142-101 kubenswrapper[2572]: E0711 04:27:23.164038 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7242-139751907488816\" is forbidden: User \"system:node:ip-10-0-142-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-101.ec2.internal' and this object" podUID="7fd255d4-a546-41bc-b86c-9c03e615657f" pod="openshift-ingress/test-curl-7242-139751907488816" Jul 11 04:27:23.836010 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:23.835978 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd255d4-a546-41bc-b86c-9c03e615657f" path="/var/lib/kubelet/pods/7fd255d4-a546-41bc-b86c-9c03e615657f/volumes" Jul 11 04:27:24.161393 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:24.161355 2572 generic.go:356] "Generic (PLEG): container finished" podID="55284a8a-6ec0-4e95-b991-7d3fdbec6c40" containerID="0c67f4b9a57aa0f2b600a1cab108f0d26dbc98db6d8bc4a021219f647adf5f80" exitCode=0 Jul 11 04:27:24.161572 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:24.161448 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907565616" event={"ID":"55284a8a-6ec0-4e95-b991-7d3fdbec6c40","Type":"ContainerDied","Data":"0c67f4b9a57aa0f2b600a1cab108f0d26dbc98db6d8bc4a021219f647adf5f80"} Jul 11 04:27:25.327331 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.327309 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:25.341624 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.341583 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67h22\" (UniqueName: \"kubernetes.io/projected/55284a8a-6ec0-4e95-b991-7d3fdbec6c40-kube-api-access-67h22\") pod \"55284a8a-6ec0-4e95-b991-7d3fdbec6c40\" (UID: \"55284a8a-6ec0-4e95-b991-7d3fdbec6c40\") " Jul 11 04:27:25.344327 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.344288 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55284a8a-6ec0-4e95-b991-7d3fdbec6c40-kube-api-access-67h22" (OuterVolumeSpecName: "kube-api-access-67h22") pod "55284a8a-6ec0-4e95-b991-7d3fdbec6c40" (UID: "55284a8a-6ec0-4e95-b991-7d3fdbec6c40"). InnerVolumeSpecName "kube-api-access-67h22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:25.347079 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.347053 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7242-139751907565616_55284a8a-6ec0-4e95-b991-7d3fdbec6c40/test-curl-7242-139751907565616/0.log" Jul 11 04:27:25.370472 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.370431 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:25.375456 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.375434 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:25.442832 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.442748 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67h22\" (UniqueName: \"kubernetes.io/projected/55284a8a-6ec0-4e95-b991-7d3fdbec6c40-kube-api-access-67h22\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:25.505551 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.505519 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:25.505958 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.505943 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55284a8a-6ec0-4e95-b991-7d3fdbec6c40" containerName="test-curl-7242-139751907565616" Jul 11 04:27:25.506009 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.505959 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="55284a8a-6ec0-4e95-b991-7d3fdbec6c40" containerName="test-curl-7242-139751907565616" Jul 11 04:27:25.508489 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.506442 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="55284a8a-6ec0-4e95-b991-7d3fdbec6c40" containerName="test-curl-7242-139751907565616" Jul 11 04:27:25.510798 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.510771 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:25.516444 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.516422 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:25.543943 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.543912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2s9z\" (UniqueName: \"kubernetes.io/projected/e63f36ca-9776-49e5-b12a-60e19cd2aaba-kube-api-access-m2s9z\") pod \"test-curl-7242-139751907565616\" (UID: \"e63f36ca-9776-49e5-b12a-60e19cd2aaba\") " pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:25.645051 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.645013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2s9z\" (UniqueName: \"kubernetes.io/projected/e63f36ca-9776-49e5-b12a-60e19cd2aaba-kube-api-access-m2s9z\") pod \"test-curl-7242-139751907565616\" (UID: \"e63f36ca-9776-49e5-b12a-60e19cd2aaba\") " pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:25.653558 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.653534 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2s9z\" (UniqueName: \"kubernetes.io/projected/e63f36ca-9776-49e5-b12a-60e19cd2aaba-kube-api-access-m2s9z\") pod \"test-curl-7242-139751907565616\" (UID: \"e63f36ca-9776-49e5-b12a-60e19cd2aaba\") " pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:25.821765 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.821675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:25.835997 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.835968 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55284a8a-6ec0-4e95-b991-7d3fdbec6c40" path="/var/lib/kubelet/pods/55284a8a-6ec0-4e95-b991-7d3fdbec6c40/volumes" Jul 11 04:27:25.956552 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:25.956527 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:25.958150 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:27:25.958119 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode63f36ca_9776_49e5_b12a_60e19cd2aaba.slice/crio-b2e5581fdfc92d5e9315fb2c3b3952788ee8f0f8e6551adb64b42daca42788ed WatchSource:0}: Error finding container b2e5581fdfc92d5e9315fb2c3b3952788ee8f0f8e6551adb64b42daca42788ed: Status 404 returned error can't find the container with id b2e5581fdfc92d5e9315fb2c3b3952788ee8f0f8e6551adb64b42daca42788ed Jul 11 04:27:26.176926 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:26.174538 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:26.176926 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:26.174950 2572 scope.go:117] "RemoveContainer" containerID="0c67f4b9a57aa0f2b600a1cab108f0d26dbc98db6d8bc4a021219f647adf5f80" Jul 11 04:27:26.178949 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:26.178878 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907565616" event={"ID":"e63f36ca-9776-49e5-b12a-60e19cd2aaba","Type":"ContainerStarted","Data":"b2e5581fdfc92d5e9315fb2c3b3952788ee8f0f8e6551adb64b42daca42788ed"} Jul 11 04:27:27.187137 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:27.187101 2572 generic.go:356] "Generic (PLEG): container finished" podID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" containerID="7266a23d4e7e3af2e76f72cf4f6367addc1050c6757a27467edd58e69bc15c2a" exitCode=0 Jul 11 04:27:27.187506 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:27.187144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907565616" event={"ID":"e63f36ca-9776-49e5-b12a-60e19cd2aaba","Type":"ContainerDied","Data":"7266a23d4e7e3af2e76f72cf4f6367addc1050c6757a27467edd58e69bc15c2a"} Jul 11 04:27:28.333124 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.333099 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:28.352687 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.352651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7242-139751907565616_e63f36ca-9776-49e5-b12a-60e19cd2aaba/test-curl-7242-139751907565616/0.log" Jul 11 04:27:28.365941 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.365913 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2s9z\" (UniqueName: \"kubernetes.io/projected/e63f36ca-9776-49e5-b12a-60e19cd2aaba-kube-api-access-m2s9z\") pod \"e63f36ca-9776-49e5-b12a-60e19cd2aaba\" (UID: \"e63f36ca-9776-49e5-b12a-60e19cd2aaba\") " Jul 11 04:27:28.368177 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.368141 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e63f36ca-9776-49e5-b12a-60e19cd2aaba-kube-api-access-m2s9z" (OuterVolumeSpecName: "kube-api-access-m2s9z") pod "e63f36ca-9776-49e5-b12a-60e19cd2aaba" (UID: "e63f36ca-9776-49e5-b12a-60e19cd2aaba"). InnerVolumeSpecName "kube-api-access-m2s9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:28.376669 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.376646 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:28.379757 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.379734 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7242-139751907565616"] Jul 11 04:27:28.467049 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.466963 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2s9z\" (UniqueName: \"kubernetes.io/projected/e63f36ca-9776-49e5-b12a-60e19cd2aaba-kube-api-access-m2s9z\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:28.495223 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.495192 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:28.495610 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.495596 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" containerName="test-curl-7242-139751907565616" Jul 11 04:27:28.495666 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.495613 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" containerName="test-curl-7242-139751907565616" Jul 11 04:27:28.495702 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.495691 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" containerName="test-curl-7242-139751907565616" Jul 11 04:27:28.498759 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.498743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:28.504900 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.504875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:28.567470 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.567433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq4p6\" (UniqueName: \"kubernetes.io/projected/b4f5accd-eff8-48be-913b-86cded368cb3-kube-api-access-bq4p6\") pod \"test-curl-7242-139751907566624\" (UID: \"b4f5accd-eff8-48be-913b-86cded368cb3\") " pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:28.668586 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.668546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq4p6\" (UniqueName: \"kubernetes.io/projected/b4f5accd-eff8-48be-913b-86cded368cb3-kube-api-access-bq4p6\") pod \"test-curl-7242-139751907566624\" (UID: \"b4f5accd-eff8-48be-913b-86cded368cb3\") " pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:28.677297 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.677262 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq4p6\" (UniqueName: \"kubernetes.io/projected/b4f5accd-eff8-48be-913b-86cded368cb3-kube-api-access-bq4p6\") pod \"test-curl-7242-139751907566624\" (UID: \"b4f5accd-eff8-48be-913b-86cded368cb3\") " pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:28.809219 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.809128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:28.942258 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:28.942231 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:28.944215 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:27:28.944179 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4f5accd_eff8_48be_913b_86cded368cb3.slice/crio-2415f0e6fc851f57fb8d53253e302ceaa2ea5c525f9118ed4fb585ecb9fd3f65 WatchSource:0}: Error finding container 2415f0e6fc851f57fb8d53253e302ceaa2ea5c525f9118ed4fb585ecb9fd3f65: Status 404 returned error can't find the container with id 2415f0e6fc851f57fb8d53253e302ceaa2ea5c525f9118ed4fb585ecb9fd3f65 Jul 11 04:27:29.206198 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:29.206166 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:29.206198 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:29.206194 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2e5581fdfc92d5e9315fb2c3b3952788ee8f0f8e6551adb64b42daca42788ed" Jul 11 04:27:29.207647 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:29.207619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907566624" event={"ID":"b4f5accd-eff8-48be-913b-86cded368cb3","Type":"ContainerStarted","Data":"2415f0e6fc851f57fb8d53253e302ceaa2ea5c525f9118ed4fb585ecb9fd3f65"} Jul 11 04:27:29.216254 ip-10-0-142-101 kubenswrapper[2572]: E0711 04:27:29.216229 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7242-139751907565616\" is forbidden: User \"system:node:ip-10-0-142-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-101.ec2.internal' and this object" podUID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:29.835042 ip-10-0-142-101 kubenswrapper[2572]: E0711 04:27:29.835005 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7242-139751907565616\" is forbidden: User \"system:node:ip-10-0-142-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-101.ec2.internal' and this object" podUID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" pod="openshift-ingress/test-curl-7242-139751907565616" Jul 11 04:27:29.836681 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:29.836659 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e63f36ca-9776-49e5-b12a-60e19cd2aaba" path="/var/lib/kubelet/pods/e63f36ca-9776-49e5-b12a-60e19cd2aaba/volumes" Jul 11 04:27:29.946344 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:29.946299 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" podUID="8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" containerName="main" containerID="cri-o://d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9" gracePeriod=45 Jul 11 04:27:30.198731 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.198705 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:27:30.213771 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.213741 2572 generic.go:356] "Generic (PLEG): container finished" podID="8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" containerID="d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9" exitCode=0 Jul 11 04:27:30.213960 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.213781 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" Jul 11 04:27:30.213960 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.213818 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" event={"ID":"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e","Type":"ContainerDied","Data":"d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9"} Jul 11 04:27:30.213960 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.213877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g" event={"ID":"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e","Type":"ContainerDied","Data":"1b3a546db4ef27bbc67cd6b0f58db0b1513ad068c9c9cc31b92473ee32061bc2"} Jul 11 04:27:30.213960 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.213896 2572 scope.go:117] "RemoveContainer" containerID="d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9" Jul 11 04:27:30.215509 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.215422 2572 generic.go:356] "Generic (PLEG): container finished" podID="b4f5accd-eff8-48be-913b-86cded368cb3" containerID="515b811c6870a235c29e476533872021e46c9eab64be602767cce8d64ad0b586" exitCode=0 Jul 11 04:27:30.215509 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.215452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907566624" event={"ID":"b4f5accd-eff8-48be-913b-86cded368cb3","Type":"ContainerDied","Data":"515b811c6870a235c29e476533872021e46c9eab64be602767cce8d64ad0b586"} Jul 11 04:27:30.223807 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.223786 2572 scope.go:117] "RemoveContainer" containerID="d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9" Jul 11 04:27:30.224223 ip-10-0-142-101 kubenswrapper[2572]: E0711 04:27:30.224201 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9\": container with ID starting with d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9 not found: ID does not exist" containerID="d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9" Jul 11 04:27:30.224297 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.224234 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9"} err="failed to get container status \"d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9\": rpc error: code = NotFound desc = could not find container \"d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9\": container with ID starting with d778d9ad2281971b4cb9882bd2d19b741c4557224647bf5b69ae8273aa8aeff9 not found: ID does not exist" Jul 11 04:27:30.282557 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282517 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-dshm\") pod \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " Jul 11 04:27:30.282731 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282590 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n7rj\" (UniqueName: \"kubernetes.io/projected/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-kube-api-access-2n7rj\") pod \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " Jul 11 04:27:30.282731 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282621 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tmp-dir\") pod \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " Jul 11 04:27:30.282731 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282694 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-home\") pod \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " Jul 11 04:27:30.282936 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282729 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tls-certs\") pod \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " Jul 11 04:27:30.282936 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282762 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-model-cache\") pod \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\" (UID: \"8b3df2cc-1a48-4ad7-8215-d865d6c3f03e\") " Jul 11 04:27:30.283045 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.282975 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" (UID: "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:27:30.283045 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.283007 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-home" (OuterVolumeSpecName: "home") pod "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" (UID: "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:27:30.283133 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.283068 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tmp-dir\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:30.283133 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.283091 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-model-cache" (OuterVolumeSpecName: "model-cache") pod "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" (UID: "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:27:30.284920 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.284901 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-dshm" (OuterVolumeSpecName: "dshm") pod "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" (UID: "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 11 04:27:30.285002 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.284944 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" (UID: "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 04:27:30.285002 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.284954 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-kube-api-access-2n7rj" (OuterVolumeSpecName: "kube-api-access-2n7rj") pod "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" (UID: "8b3df2cc-1a48-4ad7-8215-d865d6c3f03e"). InnerVolumeSpecName "kube-api-access-2n7rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:30.384230 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.384129 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-home\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:30.384230 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.384163 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-tls-certs\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:30.384230 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.384177 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-model-cache\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:30.384230 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.384215 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-dshm\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:30.384230 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.384228 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n7rj\" (UniqueName: \"kubernetes.io/projected/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e-kube-api-access-2n7rj\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:30.534191 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.534159 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g"] Jul 11 04:27:30.537915 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:30.537890 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6ee78d/rate-test-model-6ee78d-kserve-6464498ddc-5pm6g"] Jul 11 04:27:31.358295 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.358267 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:31.376391 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.376363 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7242-139751907566624_b4f5accd-eff8-48be-913b-86cded368cb3/test-curl-7242-139751907566624/0.log" Jul 11 04:27:31.391663 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.391634 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq4p6\" (UniqueName: \"kubernetes.io/projected/b4f5accd-eff8-48be-913b-86cded368cb3-kube-api-access-bq4p6\") pod \"b4f5accd-eff8-48be-913b-86cded368cb3\" (UID: \"b4f5accd-eff8-48be-913b-86cded368cb3\") " Jul 11 04:27:31.393801 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.393774 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4f5accd-eff8-48be-913b-86cded368cb3-kube-api-access-bq4p6" (OuterVolumeSpecName: "kube-api-access-bq4p6") pod "b4f5accd-eff8-48be-913b-86cded368cb3" (UID: "b4f5accd-eff8-48be-913b-86cded368cb3"). InnerVolumeSpecName "kube-api-access-bq4p6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:31.401028 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.400998 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:31.403079 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.403059 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:31.493124 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.493043 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq4p6\" (UniqueName: \"kubernetes.io/projected/b4f5accd-eff8-48be-913b-86cded368cb3-kube-api-access-bq4p6\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:31.519904 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.519868 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:31.520264 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.520251 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" containerName="main" Jul 11 04:27:31.520307 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.520267 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" containerName="main" Jul 11 04:27:31.520307 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.520279 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4f5accd-eff8-48be-913b-86cded368cb3" containerName="test-curl-7242-139751907566624" Jul 11 04:27:31.520307 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.520285 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4f5accd-eff8-48be-913b-86cded368cb3" containerName="test-curl-7242-139751907566624" Jul 11 04:27:31.520397 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.520342 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4f5accd-eff8-48be-913b-86cded368cb3" containerName="test-curl-7242-139751907566624" Jul 11 04:27:31.520397 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.520352 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" containerName="main" Jul 11 04:27:31.523329 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.523313 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:31.527768 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.527741 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:31.594215 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.594180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crp9l\" (UniqueName: \"kubernetes.io/projected/cb830100-76d1-4108-9247-c78354d75e2b-kube-api-access-crp9l\") pod \"test-curl-7242-139751907566624\" (UID: \"cb830100-76d1-4108-9247-c78354d75e2b\") " pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:31.695306 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.695272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crp9l\" (UniqueName: \"kubernetes.io/projected/cb830100-76d1-4108-9247-c78354d75e2b-kube-api-access-crp9l\") pod \"test-curl-7242-139751907566624\" (UID: \"cb830100-76d1-4108-9247-c78354d75e2b\") " pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:31.702855 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.702811 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crp9l\" (UniqueName: \"kubernetes.io/projected/cb830100-76d1-4108-9247-c78354d75e2b-kube-api-access-crp9l\") pod \"test-curl-7242-139751907566624\" (UID: \"cb830100-76d1-4108-9247-c78354d75e2b\") " pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:31.833406 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.833313 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:31.836514 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.836484 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b3df2cc-1a48-4ad7-8215-d865d6c3f03e" path="/var/lib/kubelet/pods/8b3df2cc-1a48-4ad7-8215-d865d6c3f03e/volumes" Jul 11 04:27:31.836987 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.836965 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4f5accd-eff8-48be-913b-86cded368cb3" path="/var/lib/kubelet/pods/b4f5accd-eff8-48be-913b-86cded368cb3/volumes" Jul 11 04:27:31.967516 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:31.967495 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:31.968832 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:27:31.968808 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb830100_76d1_4108_9247_c78354d75e2b.slice/crio-a37b15888f1e8a38728ca4d65f3a935b1698dc92c8584fef09359a4e3989b5cb WatchSource:0}: Error finding container a37b15888f1e8a38728ca4d65f3a935b1698dc92c8584fef09359a4e3989b5cb: Status 404 returned error can't find the container with id a37b15888f1e8a38728ca4d65f3a935b1698dc92c8584fef09359a4e3989b5cb Jul 11 04:27:32.229913 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:32.229884 2572 scope.go:117] "RemoveContainer" containerID="515b811c6870a235c29e476533872021e46c9eab64be602767cce8d64ad0b586" Jul 11 04:27:32.230104 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:32.229890 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:32.231116 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:32.231005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907566624" event={"ID":"cb830100-76d1-4108-9247-c78354d75e2b","Type":"ContainerStarted","Data":"a37b15888f1e8a38728ca4d65f3a935b1698dc92c8584fef09359a4e3989b5cb"} Jul 11 04:27:33.239296 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:33.239258 2572 generic.go:356] "Generic (PLEG): container finished" podID="cb830100-76d1-4108-9247-c78354d75e2b" containerID="1d73d0211dffba8cdc451277da5311fb0b9fa29ea85e42bfb30a061eda006b4d" exitCode=0 Jul 11 04:27:33.239685 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:33.239346 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7242-139751907566624" event={"ID":"cb830100-76d1-4108-9247-c78354d75e2b","Type":"ContainerDied","Data":"1d73d0211dffba8cdc451277da5311fb0b9fa29ea85e42bfb30a061eda006b4d"} Jul 11 04:27:34.385324 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.385297 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:34.405108 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.405082 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7242-139751907566624_cb830100-76d1-4108-9247-c78354d75e2b/test-curl-7242-139751907566624/0.log" Jul 11 04:27:34.428113 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.428084 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crp9l\" (UniqueName: \"kubernetes.io/projected/cb830100-76d1-4108-9247-c78354d75e2b-kube-api-access-crp9l\") pod \"cb830100-76d1-4108-9247-c78354d75e2b\" (UID: \"cb830100-76d1-4108-9247-c78354d75e2b\") " Jul 11 04:27:34.428665 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.428641 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:34.430653 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.430628 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb830100-76d1-4108-9247-c78354d75e2b-kube-api-access-crp9l" (OuterVolumeSpecName: "kube-api-access-crp9l") pod "cb830100-76d1-4108-9247-c78354d75e2b" (UID: "cb830100-76d1-4108-9247-c78354d75e2b"). InnerVolumeSpecName "kube-api-access-crp9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 04:27:34.432222 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.432200 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7242-139751907566624"] Jul 11 04:27:34.529304 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:34.529211 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crp9l\" (UniqueName: \"kubernetes.io/projected/cb830100-76d1-4108-9247-c78354d75e2b-kube-api-access-crp9l\") on node \"ip-10-0-142-101.ec2.internal\" DevicePath \"\"" Jul 11 04:27:35.252022 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:35.251993 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a37b15888f1e8a38728ca4d65f3a935b1698dc92c8584fef09359a4e3989b5cb" Jul 11 04:27:35.252022 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:35.252009 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:35.261132 ip-10-0-142-101 kubenswrapper[2572]: E0711 04:27:35.261105 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7242-139751907566624\" is forbidden: User \"system:node:ip-10-0-142-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-101.ec2.internal' and this object" podUID="cb830100-76d1-4108-9247-c78354d75e2b" pod="openshift-ingress/test-curl-7242-139751907566624" Jul 11 04:27:35.836588 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:27:35.836558 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb830100-76d1-4108-9247-c78354d75e2b" path="/var/lib/kubelet/pods/cb830100-76d1-4108-9247-c78354d75e2b/volumes" Jul 11 04:28:27.200544 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:27.200512 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dc49c57b6-6lwgx_80da3d46-5d62-4c6e-aedc-887bb063f7a8/authorino/0.log" Jul 11 04:28:32.870262 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:32.870229 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7766d5cd97-lttqs_2d74db17-1118-4b20-abdb-60efdbfa8e4f/copy-manifests/0.log" Jul 11 04:28:32.882453 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:32.882418 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7766d5cd97-lttqs_2d74db17-1118-4b20-abdb-60efdbfa8e4f/manager/0.log" Jul 11 04:28:35.805027 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:35.804998 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p_4cc801dd-f624-4ab0-bd93-d5fa81d03bc6/util/0.log" Jul 11 04:28:35.810941 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:35.810907 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p_4cc801dd-f624-4ab0-bd93-d5fa81d03bc6/pull/0.log" Jul 11 04:28:35.816518 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:35.816499 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p_4cc801dd-f624-4ab0-bd93-d5fa81d03bc6/extract/0.log" Jul 11 04:28:35.931259 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:35.931225 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6_7a190f80-cbbe-42ad-b4b7-0b4d5f13e856/util/0.log" Jul 11 04:28:35.937983 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:35.937957 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6_7a190f80-cbbe-42ad-b4b7-0b4d5f13e856/pull/0.log" Jul 11 04:28:35.944368 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:35.944348 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6_7a190f80-cbbe-42ad-b4b7-0b4d5f13e856/extract/0.log" Jul 11 04:28:36.053688 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.053659 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27_76747892-3b00-41cc-912a-6691b526005f/util/0.log" Jul 11 04:28:36.060427 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.060365 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27_76747892-3b00-41cc-912a-6691b526005f/pull/0.log" Jul 11 04:28:36.066962 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.066938 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27_76747892-3b00-41cc-912a-6691b526005f/extract/0.log" Jul 11 04:28:36.193594 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.193553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67_e4b591ad-5b98-4b81-941f-0d99a572f013/util/0.log" Jul 11 04:28:36.200168 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.200146 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67_e4b591ad-5b98-4b81-941f-0d99a572f013/pull/0.log" Jul 11 04:28:36.205876 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.205855 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67_e4b591ad-5b98-4b81-941f-0d99a572f013/extract/0.log" Jul 11 04:28:36.321677 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:36.321597 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dc49c57b6-6lwgx_80da3d46-5d62-4c6e-aedc-887bb063f7a8/authorino/0.log" Jul 11 04:28:37.115891 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:37.115857 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tgs9z_d37376e5-5cc2-4626-be1a-39959180ef65/manager/0.log" Jul 11 04:28:37.685668 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:37.685638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cfbd58d5-8hfc5_794e3ffd-5a69-4934-8596-a11653e0372a/kube-auth-proxy/0.log" Jul 11 04:28:38.850695 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:38.850663 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vvjr2_ac61dba5-4bc8-44d5-bdf3-83547acba347/main/0.log" Jul 11 04:28:39.064651 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:39.064621 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-trxjb_c098f4e2-0b9e-4f38-bf69-a0fc5989bc56/main/0.log" Jul 11 04:28:43.073897 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.073856 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cfvxb/must-gather-nng2n"] Jul 11 04:28:43.074295 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.074246 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb830100-76d1-4108-9247-c78354d75e2b" containerName="test-curl-7242-139751907566624" Jul 11 04:28:43.074295 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.074259 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb830100-76d1-4108-9247-c78354d75e2b" containerName="test-curl-7242-139751907566624" Jul 11 04:28:43.074433 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.074376 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb830100-76d1-4108-9247-c78354d75e2b" containerName="test-curl-7242-139751907566624" Jul 11 04:28:43.077688 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.077671 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.079989 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.079964 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cfvxb\"/\"openshift-service-ca.crt\"" Jul 11 04:28:43.080127 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.080029 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cfvxb\"/\"default-dockercfg-tsckk\"" Jul 11 04:28:43.080127 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.079999 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cfvxb\"/\"kube-root-ca.crt\"" Jul 11 04:28:43.087586 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.087561 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cfvxb/must-gather-nng2n"] Jul 11 04:28:43.144366 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.144330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvbzl\" (UniqueName: \"kubernetes.io/projected/27c21383-2ba5-43f9-9ae8-5084cf3f1f70-kube-api-access-hvbzl\") pod \"must-gather-nng2n\" (UID: \"27c21383-2ba5-43f9-9ae8-5084cf3f1f70\") " pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.144567 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.144473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/27c21383-2ba5-43f9-9ae8-5084cf3f1f70-must-gather-output\") pod \"must-gather-nng2n\" (UID: \"27c21383-2ba5-43f9-9ae8-5084cf3f1f70\") " pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.245576 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.245540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/27c21383-2ba5-43f9-9ae8-5084cf3f1f70-must-gather-output\") pod \"must-gather-nng2n\" (UID: \"27c21383-2ba5-43f9-9ae8-5084cf3f1f70\") " pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.245741 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.245596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvbzl\" (UniqueName: \"kubernetes.io/projected/27c21383-2ba5-43f9-9ae8-5084cf3f1f70-kube-api-access-hvbzl\") pod \"must-gather-nng2n\" (UID: \"27c21383-2ba5-43f9-9ae8-5084cf3f1f70\") " pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.245982 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.245961 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/27c21383-2ba5-43f9-9ae8-5084cf3f1f70-must-gather-output\") pod \"must-gather-nng2n\" (UID: \"27c21383-2ba5-43f9-9ae8-5084cf3f1f70\") " pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.255129 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.255102 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvbzl\" (UniqueName: \"kubernetes.io/projected/27c21383-2ba5-43f9-9ae8-5084cf3f1f70-kube-api-access-hvbzl\") pod \"must-gather-nng2n\" (UID: \"27c21383-2ba5-43f9-9ae8-5084cf3f1f70\") " pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.388541 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.388514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cfvxb/must-gather-nng2n" Jul 11 04:28:43.520746 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.520721 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cfvxb/must-gather-nng2n"] Jul 11 04:28:43.522863 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:28:43.522815 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27c21383_2ba5_43f9_9ae8_5084cf3f1f70.slice/crio-62dd4a80d9692be9280db578238ae43b4a6c5004a3ba9b9c22c255ba22c0049c WatchSource:0}: Error finding container 62dd4a80d9692be9280db578238ae43b4a6c5004a3ba9b9c22c255ba22c0049c: Status 404 returned error can't find the container with id 62dd4a80d9692be9280db578238ae43b4a6c5004a3ba9b9c22c255ba22c0049c Jul 11 04:28:43.621086 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:43.621057 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cfvxb/must-gather-nng2n" event={"ID":"27c21383-2ba5-43f9-9ae8-5084cf3f1f70","Type":"ContainerStarted","Data":"62dd4a80d9692be9280db578238ae43b4a6c5004a3ba9b9c22c255ba22c0049c"} Jul 11 04:28:44.632399 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:44.632354 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cfvxb/must-gather-nng2n" event={"ID":"27c21383-2ba5-43f9-9ae8-5084cf3f1f70","Type":"ContainerStarted","Data":"efbb8e839e1d51c0e6293762f8f84ae79479b83b90577702baff9d81d9c7ce3d"} Jul 11 04:28:44.632889 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:44.632413 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cfvxb/must-gather-nng2n" event={"ID":"27c21383-2ba5-43f9-9ae8-5084cf3f1f70","Type":"ContainerStarted","Data":"47c46edfe2e9b2a2800352008954e4b36172aa5b4e328f8564d2f0d8f9da3e48"} Jul 11 04:28:44.649382 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:44.649319 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cfvxb/must-gather-nng2n" podStartSLOduration=0.942174823 podStartE2EDuration="1.649298186s" totalImagesPullingTime="707.123363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 04:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:28:44.646761307 +0000 UTC m=+2755.364099546" watchObservedRunningTime="2026-07-11 04:28:44.649298186 +0000 UTC m=+2755.366636425" Jul 11 04:28:45.799003 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:45.798972 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jfgct_006221a2-c572-4015-97af-6820d0ac7a4d/global-pull-secret-syncer/0.log" Jul 11 04:28:45.938982 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:45.938952 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x5nb4_181d637f-b639-4b48-ab70-bb7ab1d2f539/konnectivity-agent/0.log" Jul 11 04:28:46.011108 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:46.011079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-101.ec2.internal_077fca01a64486b516cac217b95ed2fa/haproxy/0.log" Jul 11 04:28:50.081032 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.080997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p_4cc801dd-f624-4ab0-bd93-d5fa81d03bc6/extract/0.log" Jul 11 04:28:50.105482 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.105446 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p_4cc801dd-f624-4ab0-bd93-d5fa81d03bc6/util/0.log" Jul 11 04:28:50.126954 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.126914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tgn4p_4cc801dd-f624-4ab0-bd93-d5fa81d03bc6/pull/0.log" Jul 11 04:28:50.159355 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.159325 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6_7a190f80-cbbe-42ad-b4b7-0b4d5f13e856/extract/0.log" Jul 11 04:28:50.185285 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.185250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6_7a190f80-cbbe-42ad-b4b7-0b4d5f13e856/util/0.log" Jul 11 04:28:50.206217 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.206188 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x9lt6_7a190f80-cbbe-42ad-b4b7-0b4d5f13e856/pull/0.log" Jul 11 04:28:50.238960 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.235533 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27_76747892-3b00-41cc-912a-6691b526005f/extract/0.log" Jul 11 04:28:50.259919 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.259891 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27_76747892-3b00-41cc-912a-6691b526005f/util/0.log" Jul 11 04:28:50.283041 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.282999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372r27_76747892-3b00-41cc-912a-6691b526005f/pull/0.log" Jul 11 04:28:50.308696 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.308669 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67_e4b591ad-5b98-4b81-941f-0d99a572f013/extract/0.log" Jul 11 04:28:50.330898 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.330873 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67_e4b591ad-5b98-4b81-941f-0d99a572f013/util/0.log" Jul 11 04:28:50.351328 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.351304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wdw67_e4b591ad-5b98-4b81-941f-0d99a572f013/pull/0.log" Jul 11 04:28:50.723505 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:50.723051 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dc49c57b6-6lwgx_80da3d46-5d62-4c6e-aedc-887bb063f7a8/authorino/0.log" Jul 11 04:28:51.183554 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:51.183518 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tgs9z_d37376e5-5cc2-4626-be1a-39959180ef65/manager/0.log" Jul 11 04:28:52.869906 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:52.869880 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/alertmanager/0.log" Jul 11 04:28:52.895678 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:52.895652 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/config-reloader/0.log" Jul 11 04:28:52.918453 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:52.918410 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/kube-rbac-proxy-web/0.log" Jul 11 04:28:52.939984 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:52.939950 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/kube-rbac-proxy/0.log" Jul 11 04:28:52.965099 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:52.965059 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/kube-rbac-proxy-metric/0.log" Jul 11 04:28:52.991091 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:52.991067 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/prom-label-proxy/0.log" Jul 11 04:28:53.022752 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.022720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_eb334c35-5518-46e7-8ef6-9727d43298db/init-config-reloader/0.log" Jul 11 04:28:53.083571 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.083544 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gzjxz_3ed2f4e0-419f-4431-945c-786f2239af78/kube-state-metrics/0.log" Jul 11 04:28:53.102471 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.102441 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gzjxz_3ed2f4e0-419f-4431-945c-786f2239af78/kube-rbac-proxy-main/0.log" Jul 11 04:28:53.125202 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.125094 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gzjxz_3ed2f4e0-419f-4431-945c-786f2239af78/kube-rbac-proxy-self/0.log" Jul 11 04:28:53.188057 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.187997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-g7pjl_849cc20b-6559-46ad-9a30-6f1fec7b7000/monitoring-plugin/0.log" Jul 11 04:28:53.327636 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.327607 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptkxg_2e653c35-1c03-4a15-87ad-4e144238dc2b/node-exporter/0.log" Jul 11 04:28:53.355561 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.355535 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptkxg_2e653c35-1c03-4a15-87ad-4e144238dc2b/kube-rbac-proxy/0.log" Jul 11 04:28:53.402118 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.402047 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptkxg_2e653c35-1c03-4a15-87ad-4e144238dc2b/init-textfile/0.log" Jul 11 04:28:53.533105 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.533076 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-mx7rk_737016a3-95e2-45a0-b9c8-ac1b9131c85b/kube-rbac-proxy-main/0.log" Jul 11 04:28:53.558672 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.558638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-mx7rk_737016a3-95e2-45a0-b9c8-ac1b9131c85b/kube-rbac-proxy-self/0.log" Jul 11 04:28:53.583019 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.582975 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-mx7rk_737016a3-95e2-45a0-b9c8-ac1b9131c85b/openshift-state-metrics/0.log" Jul 11 04:28:53.796503 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.796422 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hz8wp_27aab0e0-e40e-4e58-89c9-781af6a8d276/prometheus-operator/0.log" Jul 11 04:28:53.818428 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.818397 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hz8wp_27aab0e0-e40e-4e58-89c9-781af6a8d276/kube-rbac-proxy/0.log" Jul 11 04:28:53.843319 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.843287 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-fllsd_abe81ddc-dc5a-42f4-a0c6-fd2cab74b357/prometheus-operator-admission-webhook/0.log" Jul 11 04:28:53.883077 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.883037 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-787f45c9c6-nkdv8_095cfff8-02f2-48f6-ad68-67d6268aea7b/telemeter-client/0.log" Jul 11 04:28:53.904778 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.904744 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-787f45c9c6-nkdv8_095cfff8-02f2-48f6-ad68-67d6268aea7b/reload/0.log" Jul 11 04:28:53.927140 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.927109 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-787f45c9c6-nkdv8_095cfff8-02f2-48f6-ad68-67d6268aea7b/kube-rbac-proxy/0.log" Jul 11 04:28:53.961229 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.961203 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546566c6bb-w4bzr_7c8d98b1-e5cf-42a3-a07d-61b875fafac3/thanos-query/0.log" Jul 11 04:28:53.982487 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:53.982460 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546566c6bb-w4bzr_7c8d98b1-e5cf-42a3-a07d-61b875fafac3/kube-rbac-proxy-web/0.log" Jul 11 04:28:54.007303 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:54.007278 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546566c6bb-w4bzr_7c8d98b1-e5cf-42a3-a07d-61b875fafac3/kube-rbac-proxy/0.log" Jul 11 04:28:54.028317 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:54.028287 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546566c6bb-w4bzr_7c8d98b1-e5cf-42a3-a07d-61b875fafac3/prom-label-proxy/0.log" Jul 11 04:28:54.050583 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:54.050473 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546566c6bb-w4bzr_7c8d98b1-e5cf-42a3-a07d-61b875fafac3/kube-rbac-proxy-rules/0.log" Jul 11 04:28:54.072864 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:54.072818 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546566c6bb-w4bzr_7c8d98b1-e5cf-42a3-a07d-61b875fafac3/kube-rbac-proxy-metrics/0.log" Jul 11 04:28:56.462602 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.462555 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z"] Jul 11 04:28:56.470922 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.470890 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.474512 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.474445 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z"] Jul 11 04:28:56.592794 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.592757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7dg2\" (UniqueName: \"kubernetes.io/projected/8744996c-c387-46f5-a288-c4fe586287be-kube-api-access-r7dg2\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.592985 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.592801 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-podres\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.592985 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.592865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-proc\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.592985 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.592903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-lib-modules\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.593145 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.592987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-sys\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.624476 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.624439 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-8skgc_7f7d68f9-b251-4e30-8b36-9d1a72c3db75/download-server/0.log" Jul 11 04:28:56.693799 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693759 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7dg2\" (UniqueName: \"kubernetes.io/projected/8744996c-c387-46f5-a288-c4fe586287be-kube-api-access-r7dg2\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.693799 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-podres\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694074 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-proc\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694074 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693925 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-lib-modules\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694074 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-sys\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694074 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-podres\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694074 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.693999 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-proc\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694276 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.694079 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-sys\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.694276 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.694113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8744996c-c387-46f5-a288-c4fe586287be-lib-modules\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.702666 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.702646 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7dg2\" (UniqueName: \"kubernetes.io/projected/8744996c-c387-46f5-a288-c4fe586287be-kube-api-access-r7dg2\") pod \"perf-node-gather-daemonset-cgc2z\" (UID: \"8744996c-c387-46f5-a288-c4fe586287be\") " pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.793448 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.793367 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:56.969953 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:56.969922 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z"] Jul 11 04:28:56.972047 ip-10-0-142-101 kubenswrapper[2572]: W0711 04:28:56.972006 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8744996c_c387_46f5_a288_c4fe586287be.slice/crio-41a37ec8b2b7c182cc7ffd4609870bebcececfaba6cf7270627fd9d89f7f2d69 WatchSource:0}: Error finding container 41a37ec8b2b7c182cc7ffd4609870bebcececfaba6cf7270627fd9d89f7f2d69: Status 404 returned error can't find the container with id 41a37ec8b2b7c182cc7ffd4609870bebcececfaba6cf7270627fd9d89f7f2d69 Jul 11 04:28:57.751052 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:57.751010 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" event={"ID":"8744996c-c387-46f5-a288-c4fe586287be","Type":"ContainerStarted","Data":"7b4df5611d5c68bd10a09b435e040046ea953f45583691ecdf408d643dd535ab"} Jul 11 04:28:57.751544 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:57.751080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" event={"ID":"8744996c-c387-46f5-a288-c4fe586287be","Type":"ContainerStarted","Data":"41a37ec8b2b7c182cc7ffd4609870bebcececfaba6cf7270627fd9d89f7f2d69"} Jul 11 04:28:57.751910 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:57.751883 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:28:57.769017 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:57.768955 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" podStartSLOduration=1.768935296 podStartE2EDuration="1.768935296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 04:28:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 04:28:57.766658113 +0000 UTC m=+2768.483996347" watchObservedRunningTime="2026-07-11 04:28:57.768935296 +0000 UTC m=+2768.486273534" Jul 11 04:28:58.245779 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:58.245753 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmkcf_f80d714f-4a04-47ab-b109-52e06eaf91c9/dns/0.log" Jul 11 04:28:58.265650 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:58.265620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rmkcf_f80d714f-4a04-47ab-b109-52e06eaf91c9/kube-rbac-proxy/0.log" Jul 11 04:28:58.353635 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:58.353598 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pdfk6_e9800e7e-9028-4168-9e95-f980f495673b/dns-node-resolver/0.log" Jul 11 04:28:58.899234 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:58.899207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bf484c99f-s52q2_7ed2b65b-8820-46ab-bc3f-273dc72804c7/registry/0.log" Jul 11 04:28:58.921273 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:58.921247 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2h5c_22cd8457-4984-435a-b375-7befca8e0ea4/node-ca/0.log" Jul 11 04:28:59.990654 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:28:59.990624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cfbd58d5-8hfc5_794e3ffd-5a69-4934-8596-a11653e0372a/kube-auth-proxy/0.log" Jul 11 04:29:00.836466 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:00.836434 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-78g6r_e2d77764-4778-467c-9f4f-6006c747b166/serve-healthcheck-canary/0.log" Jul 11 04:29:01.441127 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:01.441098 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tgt5h_9ac9160c-8272-496c-a725-28ac80d68d97/kube-rbac-proxy/0.log" Jul 11 04:29:01.461739 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:01.461706 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tgt5h_9ac9160c-8272-496c-a725-28ac80d68d97/exporter/0.log" Jul 11 04:29:01.482560 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:01.482534 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tgt5h_9ac9160c-8272-496c-a725-28ac80d68d97/extractor/0.log" Jul 11 04:29:04.061398 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:04.061362 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7766d5cd97-lttqs_2d74db17-1118-4b20-abdb-60efdbfa8e4f/manager/0.log" Jul 11 04:29:04.078219 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:04.078196 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7766d5cd97-lttqs_2d74db17-1118-4b20-abdb-60efdbfa8e4f/copy-manifests/0.log" Jul 11 04:29:04.780063 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:04.780032 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cfvxb/perf-node-gather-daemonset-cgc2z" Jul 11 04:29:05.252116 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:05.252083 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d946858c4-q8q4s_02782830-7a08-4f82-be0d-cd1fab1ffb45/manager/0.log" Jul 11 04:29:05.276214 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:05.276181 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-n4n6m_236789ff-ad04-4287-b426-84fb67fc53fb/openshift-lws-operator/0.log" Jul 11 04:29:06.737831 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:06.737793 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cfbd58d5-8hfc5_794e3ffd-5a69-4934-8596-a11653e0372a/kube-auth-proxy/0.log" Jul 11 04:29:08.385241 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:08.385214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67cfbd58d5-8hfc5_794e3ffd-5a69-4934-8596-a11653e0372a/kube-auth-proxy/0.log" Jul 11 04:29:10.610313 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:10.610237 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-ghqdr_9a3f1620-6ff3-4fa4-bd31-d890cb710ac6/migrator/0.log" Jul 11 04:29:10.629716 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:10.629689 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-ghqdr_9a3f1620-6ff3-4fa4-bd31-d890cb710ac6/graceful-termination/0.log" Jul 11 04:29:12.038824 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.038797 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/kube-multus-additional-cni-plugins/0.log" Jul 11 04:29:12.059408 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.059383 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/egress-router-binary-copy/0.log" Jul 11 04:29:12.079575 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.079554 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/cni-plugins/0.log" Jul 11 04:29:12.099870 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.099809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/bond-cni-plugin/0.log" Jul 11 04:29:12.119814 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.119786 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/routeoverride-cni/0.log" Jul 11 04:29:12.139673 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.139645 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/whereabouts-cni-bincopy/0.log" Jul 11 04:29:12.160257 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.160230 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv9kd_dffbef86-9c16-4aee-b2cf-f2541f11d646/whereabouts-cni/0.log" Jul 11 04:29:12.518292 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.518263 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mrgdx_17c4c290-15c8-48c3-9b0c-a7b47046dcb1/kube-multus/0.log" Jul 11 04:29:12.650537 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.650507 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tq6x7_cd4b3579-8747-4027-ab5e-604679a76ef8/network-metrics-daemon/0.log" Jul 11 04:29:12.668211 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:12.668177 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tq6x7_cd4b3579-8747-4027-ab5e-604679a76ef8/kube-rbac-proxy/0.log" Jul 11 04:29:13.866091 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.866039 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/ovn-controller/0.log" Jul 11 04:29:13.880950 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.880927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/ovn-acl-logging/0.log" Jul 11 04:29:13.902033 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.902009 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/kube-rbac-proxy-node/0.log" Jul 11 04:29:13.929271 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.929244 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/kube-rbac-proxy-ovn-metrics/0.log" Jul 11 04:29:13.951329 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.951303 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/northd/0.log" Jul 11 04:29:13.972304 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.972279 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/nbdb/0.log" Jul 11 04:29:13.993482 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:13.993440 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/sbdb/0.log" Jul 11 04:29:14.049788 ip-10-0-142-101 kubenswrapper[2572]: I0711 04:29:14.049759 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zvh7l_5584f4ff-e7c2-442f-88f4-ade2ed3a6a82/ovnkube-controller/0.log"