Jul 09 04:30:02.083433 ip-10-0-142-255 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 04:30:02.083445 ip-10-0-142-255 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 04:30:02.083454 ip-10-0-142-255 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 04:30:02.083766 ip-10-0-142-255 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 04:30:12.266082 ip-10-0-142-255 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 09 04:30:12.266097 ip-10-0-142-255 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c4e2dd5f357542faa92488e1c31dcf49 -- Jul 09 04:31:57.479724 ip-10-0-142-255 systemd[1]: Starting Kubernetes Kubelet... Jul 09 04:31:57.986553 ip-10-0-142-255 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:31:57.986553 ip-10-0-142-255 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 04:31:57.986553 ip-10-0-142-255 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:31:57.986553 ip-10-0-142-255 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 04:31:57.986553 ip-10-0-142-255 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:31:57.987919 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.987816 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 04:31:57.992679 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992663 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:31:57.992679 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992680 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992684 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992688 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992691 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992695 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992698 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992701 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992703 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992706 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992709 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992712 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992714 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992717 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992720 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992723 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992731 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992734 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992737 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992739 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992742 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:31:57.992744 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992746 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992748 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992752 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992755 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992758 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992790 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992793 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992796 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992799 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992804 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992808 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992811 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992814 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992816 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992819 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992822 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992825 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992827 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992830 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:31:57.993219 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992832 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992835 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992837 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992840 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992844 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992846 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992849 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992852 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992854 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992857 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992859 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992862 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992864 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992867 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992869 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992873 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992875 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992878 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992881 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992883 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:31:57.993687 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992886 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992889 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992892 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992894 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992897 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992900 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992902 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992905 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992908 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992910 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992913 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992915 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992918 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992920 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992923 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992927 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992930 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992932 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992935 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:31:57.994150 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992939 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992943 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992946 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992949 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992952 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992954 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992957 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992959 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992963 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992965 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992968 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992971 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992973 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992976 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992979 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992982 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992984 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992986 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992989 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.992992 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:31:57.994611 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993716 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993723 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993726 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993729 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993732 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993735 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993738 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993741 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993744 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993747 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993750 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993752 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993755 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993758 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993760 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993763 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993765 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993768 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993770 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993773 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:31:57.995133 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993776 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993779 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993784 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993788 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993791 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993794 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993797 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993800 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993803 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993806 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993809 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993811 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993814 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993817 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993820 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993824 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993827 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993830 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993833 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:31:57.995617 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993836 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993839 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993842 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993845 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993847 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993850 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993852 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993857 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993859 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993862 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993865 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993867 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993870 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993874 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993877 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993880 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993882 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993885 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993889 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:31:57.996064 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993893 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993896 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993900 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993903 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993906 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993908 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993911 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993915 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993917 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993920 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993922 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993925 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993927 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993930 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993933 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993935 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993938 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993941 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993944 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993946 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:31:57.996530 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993949 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993952 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993954 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993957 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993960 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993963 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993966 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993969 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993971 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993974 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993977 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993979 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993982 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993984 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993987 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993989 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993992 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.993997 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994000 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:31:57.997031 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994002 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994386 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994391 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994394 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994397 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994400 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994403 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994406 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994408 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994411 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994414 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994416 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994419 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994421 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994424 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994427 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994430 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994432 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994435 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994438 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:31:57.997529 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994458 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994462 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994466 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994470 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994474 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994476 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994479 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994482 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994484 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994487 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994489 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994492 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994495 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994497 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994500 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994503 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994505 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994508 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994510 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994513 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:31:57.998037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994515 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994518 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994521 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994524 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994526 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994528 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994531 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994533 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994536 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994539 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994542 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994545 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994547 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994550 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994553 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994555 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994561 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994564 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994567 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994570 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:31:57.998525 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994573 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994576 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994579 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994582 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994585 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994587 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994590 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994593 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994595 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994597 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994601 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994604 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994606 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994609 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994611 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994614 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994617 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994620 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994622 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994625 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:31:57.999027 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994628 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994631 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994634 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994636 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994640 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994643 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994646 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994650 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994653 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994656 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994659 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994661 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994664 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994666 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994669 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994671 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994674 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994677 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994679 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.994682 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:31:57.999540 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994757 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994764 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994769 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994773 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994777 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994781 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994787 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994790 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994796 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994801 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994806 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994812 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994817 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994822 2561 flags.go:64] FLAG: --cgroup-root="" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994828 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994831 2561 flags.go:64] FLAG: --client-ca-file="" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994834 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994837 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994842 2561 flags.go:64] FLAG: --cluster-domain="" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994847 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994852 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994855 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994860 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994866 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 04:31:58.000006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994869 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994872 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994875 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994878 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994881 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994883 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994886 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994889 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994894 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994897 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994899 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994902 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994906 2561 flags.go:64] FLAG: --enable-server="true" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994909 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994914 2561 flags.go:64] FLAG: --event-burst="100" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994917 2561 flags.go:64] FLAG: --event-qps="50" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994920 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994924 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994927 2561 flags.go:64] FLAG: --eviction-hard="" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994931 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994934 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994936 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994940 2561 flags.go:64] FLAG: --eviction-soft="" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994943 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994946 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 04:31:58.000595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994949 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994952 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994955 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994957 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994960 2561 flags.go:64] FLAG: --feature-gates="" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994964 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994968 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994970 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994973 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994976 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994979 2561 flags.go:64] FLAG: --help="false" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994982 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-255.ec2.internal" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994985 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994988 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994991 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994995 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.994998 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995004 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995006 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995009 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995012 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995015 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995018 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995021 2561 flags.go:64] FLAG: --kube-reserved="" Jul 09 04:31:58.001215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995024 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995027 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995030 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995033 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995036 2561 flags.go:64] FLAG: --lock-file="" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995039 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995042 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995045 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995050 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995053 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995055 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995058 2561 flags.go:64] FLAG: --logging-format="text" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995061 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995064 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995067 2561 flags.go:64] FLAG: --manifest-url="" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995070 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995074 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995077 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995081 2561 flags.go:64] FLAG: --max-pods="110" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995085 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995087 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995090 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995093 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995096 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995099 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 04:31:58.001809 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995103 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995110 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995113 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995116 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995119 2561 flags.go:64] FLAG: --pod-cidr="" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995122 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995127 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995130 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995133 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995137 2561 flags.go:64] FLAG: --port="10250" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995140 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995143 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b86f643de8a87888" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995146 2561 flags.go:64] FLAG: --qos-reserved="" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995149 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995152 2561 flags.go:64] FLAG: --register-node="true" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995155 2561 flags.go:64] FLAG: --register-with-taints="" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995159 2561 flags.go:64] FLAG: --registry-burst="10" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995161 2561 flags.go:64] FLAG: --registry-qps="5" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995164 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995167 2561 flags.go:64] FLAG: --reserved-memory="" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995171 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995173 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995177 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995179 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995182 2561 flags.go:64] FLAG: --runonce="false" Jul 09 04:31:58.002407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995185 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995188 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995191 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995194 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995197 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995200 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995203 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995207 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995210 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995213 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995216 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995219 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995222 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995225 2561 flags.go:64] FLAG: --system-cgroups="" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995227 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995232 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995235 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995239 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995243 2561 flags.go:64] FLAG: --tls-min-version="" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995246 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995249 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995252 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995254 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995258 2561 flags.go:64] FLAG: --v="2" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995262 2561 flags.go:64] FLAG: --version="false" Jul 09 04:31:58.003053 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995265 2561 flags.go:64] FLAG: --vmodule="" Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995269 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.995272 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995420 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995424 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995427 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995430 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995433 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995437 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995454 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995458 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995462 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995465 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995468 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995473 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995477 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995480 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995483 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995486 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995488 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:31:58.003662 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995491 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995494 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995496 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995499 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995502 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995505 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995507 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995514 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995517 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995519 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995522 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995525 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995527 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995530 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995534 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995537 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995540 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995543 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995545 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:31:58.004149 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995548 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995550 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995553 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995556 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995558 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995561 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995563 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995568 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995571 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995573 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995576 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995579 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995582 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995585 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995588 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995590 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995593 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995596 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995598 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:31:58.004677 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995601 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995605 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995608 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995610 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995613 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995616 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995619 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995622 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995624 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995627 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995630 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995633 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995635 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995638 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995640 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995643 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995645 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995666 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995670 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995673 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:31:58.005153 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995677 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995680 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995683 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995687 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995690 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995692 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995695 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995698 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995700 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995703 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995706 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995708 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995711 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995717 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995721 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995724 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995727 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995730 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995733 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:31:58.005647 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995735 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995738 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995741 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995743 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:57.995746 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:57.996308 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.003469 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.003486 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.003504 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.003509 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003584 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003588 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003591 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003594 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:31:58.006099 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003597 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003599 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003602 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003605 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003607 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003610 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003613 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003616 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003618 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003621 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003624 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003627 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003636 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003639 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003642 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003645 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003647 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003650 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003652 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003655 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:31:58.006439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003657 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003659 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003662 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003665 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003668 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003671 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003674 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003676 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003679 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003681 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003684 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003687 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003689 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003692 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003694 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003696 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003699 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003702 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003707 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:31:58.006915 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003710 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003712 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003715 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003717 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003720 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003722 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003730 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003733 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003735 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003738 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003740 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003743 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003745 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003749 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003753 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003756 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003759 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003762 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003766 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:31:58.007376 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003769 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003772 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003775 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003777 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003780 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003782 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003785 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003787 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003790 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003792 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003795 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003798 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003800 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003802 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003805 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003809 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003812 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003815 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003817 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003820 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:31:58.007842 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003828 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003831 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003834 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003837 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003840 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003842 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003844 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003847 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003849 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003852 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003854 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003857 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003861 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003865 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003868 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003871 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:31:58.008369 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.003874 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.003878 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004025 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004030 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004034 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004037 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004040 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004043 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004046 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004049 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004052 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004055 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004058 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004061 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:31:58.008782 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004063 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004066 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004068 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004076 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004079 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004081 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004084 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004086 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004089 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004092 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004094 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004096 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004099 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004102 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004105 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004108 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004112 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004115 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004118 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:31:58.009132 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004121 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004123 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004126 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004128 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004131 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004133 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004136 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004138 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004141 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004143 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004151 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004154 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004156 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004159 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004163 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004166 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004169 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004177 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004179 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:31:58.009593 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004182 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004184 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004187 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004189 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004192 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004194 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004196 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004199 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004202 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004204 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004207 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004210 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004212 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004215 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004217 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004220 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004222 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004225 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004227 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004230 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:31:58.010037 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004232 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004235 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004237 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004239 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004242 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004244 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004247 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004249 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004252 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004254 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004256 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004265 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004268 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004271 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004273 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004276 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004278 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004281 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004283 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004286 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:31:58.010548 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004288 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004291 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004293 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004296 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004298 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004301 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004303 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004306 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:31:58.004308 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.004313 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.004416 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.007121 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.008379 2561 server.go:1019] "Starting client certificate rotation" Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.008495 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 04:31:58.011023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.008534 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 04:31:58.011368 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.010683 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 04:31:58.015921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.015901 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 04:31:58.026042 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.026027 2561 log.go:25] "Validated CRI v1 runtime API" Jul 09 04:31:58.028121 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.028107 2561 log.go:25] "Validated CRI v1 image API" Jul 09 04:31:58.028975 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.028961 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 04:31:58.032691 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.032670 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9d404e6f-b35f-42f7-9ad6-54d2521e218d:/dev/nvme0n1p3 cd6b1123-5f8d-45b8-8d89-4933775c4c66:/dev/nvme0n1p4] Jul 09 04:31:58.032753 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.032692 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 04:31:58.036875 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.036766 2561 manager.go:216] Machine: {Timestamp:2026-07-09 04:31:58.036280359 +0000 UTC m=+0.462168064 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3053523 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec264d1ed58ccbfb1c0d6a8ffd690cd4 SystemUUID:ec264d1e-d58c-cbfb-1c0d-6a8ffd690cd4 BootID:c4e2dd5f-3575-42fa-a924-88e1c31dcf49 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:50:1b:cc:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:50:1b:cc:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:4f:d9:8d:44:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 04:31:58.036875 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.036871 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 04:31:58.037014 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.036938 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 04:31:58.038231 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.038216 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 04:31:58.039874 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.039848 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 04:31:58.040035 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.039877 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 04:31:58.040503 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.040494 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 04:31:58.040534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.040507 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 04:31:58.040534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.040514 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 04:31:58.041194 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.041184 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 04:31:58.042482 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.042472 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 04:31:58.046533 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046522 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 09 04:31:58.046643 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046634 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 04:31:58.046678 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046663 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 09 04:31:58.046706 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046679 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 04:31:58.046706 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046696 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 04:31:58.046706 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046704 2561 kubelet.go:398] "Adding apiserver pod source" Jul 09 04:31:58.046781 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.046712 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 04:31:58.047069 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.047057 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 04:31:58.047101 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.047078 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 04:31:58.048852 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.048841 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 04:31:58.050679 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.050666 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 04:31:58.050733 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.050695 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 04:31:58.051811 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051800 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051815 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051822 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051828 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051838 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051845 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051853 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 04:31:58.051860 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051859 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 04:31:58.052064 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051865 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 04:31:58.052064 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051871 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 04:31:58.052064 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051886 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 04:31:58.052064 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.051892 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 04:31:58.052491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.052469 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 04:31:58.052491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.052490 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 04:31:58.055496 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.055483 2561 server.go:1268] "Started kubelet" Jul 09 04:31:58.055676 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.055624 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 04:31:58.055741 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.055700 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 04:31:58.056082 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.056046 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 04:31:58.056343 ip-10-0-142-255 systemd[1]: Started Kubernetes Kubelet. Jul 09 04:31:58.057520 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.057291 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 04:31:58.060305 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.060283 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 04:31:58.060585 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.060562 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 04:31:58.060664 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.060638 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 04:31:58.061292 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.061273 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 09 04:31:58.061597 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.061574 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 04:31:58.065575 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.064881 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-255.ec2.internal.18c084d88d32cccf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-255.ec2.internal,UID:ip-10-0-142-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-255.ec2.internal,},FirstTimestamp:2026-07-09 04:31:58.055435471 +0000 UTC m=+0.481323177,LastTimestamp:2026-07-09 04:31:58.055435471 +0000 UTC m=+0.481323177,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-255.ec2.internal,}" Jul 09 04:31:58.065753 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.065736 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 04:31:58.065823 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.065761 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 04:31:58.065885 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.065859 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:58.066261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.066240 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 04:31:58.066261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.066242 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 04:31:58.066405 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.066271 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 04:31:58.066475 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.066406 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 09 04:31:58.066475 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.066416 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 09 04:31:58.067204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067185 2561 factory.go:55] Registering systemd factory Jul 09 04:31:58.067279 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067209 2561 factory.go:223] Registration of the systemd container factory successfully Jul 09 04:31:58.067398 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067386 2561 factory.go:153] Registering CRI-O factory Jul 09 04:31:58.067470 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067400 2561 factory.go:223] Registration of the crio container factory successfully Jul 09 04:31:58.067470 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067455 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 04:31:58.067545 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067518 2561 factory.go:103] Registering Raw factory Jul 09 04:31:58.067545 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067529 2561 manager.go:1196] Started watching for new ooms in manager Jul 09 04:31:58.067904 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.067886 2561 manager.go:349] Starting recovery of all containers Jul 09 04:31:58.072009 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.071954 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 04:31:58.072118 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.072067 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 04:31:58.080128 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.080083 2561 manager.go:354] Recovery completed Jul 09 04:31:58.084157 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.084144 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:58.086336 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086321 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:58.086395 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086347 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:58.086395 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086367 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:58.086930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086916 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 04:31:58.086930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086928 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 04:31:58.087068 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086942 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 09 04:31:58.087068 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.086950 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:58.088215 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.088200 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:58.088286 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.088227 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:58.088286 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.088240 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:58.088389 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.088266 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-255.ec2.internal.18c084d88f0a4a72 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-255.ec2.internal,UID:ip-10-0-142-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-255.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-255.ec2.internal,},FirstTimestamp:2026-07-09 04:31:58.08633509 +0000 UTC m=+0.512222795,LastTimestamp:2026-07-09 04:31:58.08633509 +0000 UTC m=+0.512222795,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-255.ec2.internal,}" Jul 09 04:31:58.089204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.089192 2561 policy_none.go:49] "None policy: Start" Jul 09 04:31:58.089251 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.089207 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 04:31:58.089251 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.089217 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 04:31:58.091158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.091147 2561 policy_none.go:47] "Start" Jul 09 04:31:58.096558 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.096543 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmrlx" Jul 09 04:31:58.098479 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.098369 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-255.ec2.internal.18c084d88f0a8a8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-255.ec2.internal,UID:ip-10-0-142-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-255.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-255.ec2.internal,},FirstTimestamp:2026-07-09 04:31:58.086351501 +0000 UTC m=+0.512239207,LastTimestamp:2026-07-09 04:31:58.086351501 +0000 UTC m=+0.512239207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-255.ec2.internal,}" Jul 09 04:31:58.100349 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.100277 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-255.ec2.internal.18c084d88f0ada9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-255.ec2.internal,UID:ip-10-0-142-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-255.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-255.ec2.internal,},FirstTimestamp:2026-07-09 04:31:58.086371996 +0000 UTC m=+0.512259700,LastTimestamp:2026-07-09 04:31:58.086371996 +0000 UTC m=+0.512259700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-255.ec2.internal,}" Jul 09 04:31:58.103801 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.103661 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmrlx" Jul 09 04:31:58.126978 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.126961 2561 manager.go:337] "Starting Device Plugin manager" Jul 09 04:31:58.127038 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.126990 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 04:31:58.127038 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.127000 2561 server.go:87] "Starting device plugin registration server" Jul 09 04:31:58.127240 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.127227 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 04:31:58.127306 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.127240 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 04:31:58.127357 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.127345 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 04:31:58.127467 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.127435 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 04:31:58.127467 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.127464 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 04:31:58.129048 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.129016 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 04:31:58.129129 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.129067 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:58.158604 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.158583 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 04:31:58.167937 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.159662 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 04:31:58.167937 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.159695 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 04:31:58.167937 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.159713 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 04:31:58.167937 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:58.159747 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 04:31:58.167937 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:58.161923 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:31:59.504721 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.504701 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:59.505560 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.505546 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:59.505635 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.505574 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:59.505635 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.505586 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:59.505635 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.505626 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.515180 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.515144 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.515180 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.515165 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-255.ec2.internal\": node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:59.537424 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.537407 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal"] Jul 09 04:31:59.537519 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.537460 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:59.538185 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.538172 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:59.538256 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.538201 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:59.538256 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.538218 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:59.538907 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.538888 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:59.540609 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.540597 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:59.540761 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.540747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.540821 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.540781 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:59.541261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.541239 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:59.541261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.541251 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:59.541424 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.541271 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:59.541424 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.541271 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:59.541424 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.541311 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:59.541424 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.541281 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:59.543607 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.543590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.543607 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.543601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.543737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.543615 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:31:59.543737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.543626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acd4d634ee249d4b487dddc3a283d199-config\") pod \"kube-apiserver-proxy-ip-10-0-142-255.ec2.internal\" (UID: \"acd4d634ee249d4b487dddc3a283d199\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.543737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.543649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.544214 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.544198 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:31:59.544301 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.544227 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:31:59.544301 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.544241 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:31:59.561946 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.561925 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-255.ec2.internal\" not found" node="ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.565221 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.565202 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-255.ec2.internal\" not found" node="ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.639326 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.639306 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:59.644579 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.644562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.644642 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.644588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.644642 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.644604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acd4d634ee249d4b487dddc3a283d199-config\") pod \"kube-apiserver-proxy-ip-10-0-142-255.ec2.internal\" (UID: \"acd4d634ee249d4b487dddc3a283d199\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.644642 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.644639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acd4d634ee249d4b487dddc3a283d199-config\") pod \"kube-apiserver-proxy-ip-10-0-142-255.ec2.internal\" (UID: \"acd4d634ee249d4b487dddc3a283d199\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.644732 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.644670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.644732 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.644669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fad7ab4e8604dec7835d117ad532794c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal\" (UID: \"fad7ab4e8604dec7835d117ad532794c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.739769 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.739741 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:59.840533 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.840472 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:31:59.864923 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.864887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.868331 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:31:59.868314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" Jul 09 04:31:59.941360 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:31:59.941328 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.041835 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:00.041812 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.142346 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:00.142311 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.242793 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:00.242759 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.285207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.285166 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 04:32:00.285637 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.285346 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 04:32:00.336399 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.336374 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:32:00.343213 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:00.343191 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.384263 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.384222 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 04:26:59 +0000 UTC" deadline="2028-01-14 07:20:16.550576321 +0000 UTC" Jul 09 04:32:00.384263 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.384255 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13298h48m16.166325006s" Jul 09 04:32:00.443458 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:00.443397 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.519758 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.519729 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:32:00.521130 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.521114 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:32:00.521207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.521143 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:32:00.521207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.521153 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:32:00.544343 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:00.544319 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-255.ec2.internal\" not found" Jul 09 04:32:00.562895 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.562868 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:32:00.607793 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:00.607758 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad7ab4e8604dec7835d117ad532794c.slice/crio-60d1e0bb23fe1e0da35aa6c4857521424ee9cc94490554812a67fd21f6780b2d WatchSource:0}: Error finding container 60d1e0bb23fe1e0da35aa6c4857521424ee9cc94490554812a67fd21f6780b2d: Status 404 returned error can't find the container with id 60d1e0bb23fe1e0da35aa6c4857521424ee9cc94490554812a67fd21f6780b2d Jul 09 04:32:00.612105 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.612091 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:32:00.643317 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.643281 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" Jul 09 04:32:00.659307 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.659274 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 04:32:00.660128 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.660115 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" Jul 09 04:32:00.683362 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.683336 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 04:32:00.932632 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:00.932613 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:32:01.300455 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.300427 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd4d634ee249d4b487dddc3a283d199.slice/crio-05c72462121f48aabfaeae29ec3b906f2b650c4956a7329f3865870da73c5301 WatchSource:0}: Error finding container 05c72462121f48aabfaeae29ec3b906f2b650c4956a7329f3865870da73c5301: Status 404 returned error can't find the container with id 05c72462121f48aabfaeae29ec3b906f2b650c4956a7329f3865870da73c5301 Jul 09 04:32:01.324996 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.324972 2561 apiserver.go:52] "Watching apiserver" Jul 09 04:32:01.332712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.332693 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 04:32:01.333059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.333036 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal","openshift-multus/multus-additional-cni-plugins-d9mmb","openshift-multus/multus-kqsdm","openshift-multus/network-metrics-daemon-gtqwj","openshift-ovn-kubernetes/ovnkube-node-w9pzp","kube-system/global-pull-secret-syncer-lm7kb","kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5","openshift-cluster-node-tuning-operator/tuned-bcjmx","openshift-image-registry/node-ca-mckk4","openshift-network-diagnostics/network-check-target-w4mbf","openshift-network-operator/iptables-alerter-hrjm6","kube-system/konnectivity-agent-tzdhs","openshift-dns/node-resolver-8rg6r"] Jul 09 04:32:01.335736 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.335717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.337819 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.337796 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.338177 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.338159 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 04:32:01.338265 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.338177 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.338265 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.338186 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w2fr6\"" Jul 09 04:32:01.338265 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.338249 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.339887 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.339871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.340134 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.339984 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j7r9m\"" Jul 09 04:32:01.340337 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.340274 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 04:32:01.340337 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.340278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 04:32:01.341735 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.341719 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mscgq\"" Jul 09 04:32:01.341887 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.341873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.341975 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.341959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.342049 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.342027 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:01.342116 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.342101 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 04:32:01.342298 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.342266 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.342611 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.342500 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 04:32:01.343466 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.343446 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 04:32:01.344223 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.344207 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.346532 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346512 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 04:32:01.346623 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346535 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.346623 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346571 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 04:32:01.346623 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.346599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:01.346623 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346575 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bqtmb\"" Jul 09 04:32:01.346826 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346642 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.346826 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346573 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 04:32:01.346826 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346519 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.346826 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.346772 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 04:32:01.348648 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.348632 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.350732 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.350711 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.350732 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.350723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g988b\"" Jul 09 04:32:01.350854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.350825 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.350854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.350845 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.352769 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.352754 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rcs2\"" Jul 09 04:32:01.352904 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.352890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.353024 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.352958 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.353024 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.352979 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 04:32:01.353212 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.353373 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-ovnkube-script-lib\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353418 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c02b5c82-03a9-4181-b321-4ce92fb7f767-cni-binary-copy\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353456 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353413 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-cni-bin\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353497 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-systemd-units\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353497 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-log-socket\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353497 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-cnibin\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353619 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-daemon-config\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353619 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gsbk\" (UniqueName: \"kubernetes.io/projected/c02b5c82-03a9-4181-b321-4ce92fb7f767-kube-api-access-4gsbk\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353619 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-systemd\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353619 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-hostroot\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353755 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4jm\" (UniqueName: \"kubernetes.io/projected/17f4d907-f511-40e2-ab69-e98dce57a67d-kube-api-access-ww4jm\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.353755 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-run-netns\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353755 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-ovn\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353755 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9770693f-e51a-468f-b045-d9ba60e87abe-konnectivity-ca\") pod \"konnectivity-agent-tzdhs\" (UID: \"9770693f-e51a-468f-b045-d9ba60e87abe\") " pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.353755 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-cni-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-socket-dir-parent\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-k8s-cni-cncf-io\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-kubelet\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-cni-bin\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.353921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-ovnkube-config\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4e8027c-edf2-41f5-92e8-5d604198d923-ovn-node-metrics-cert\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.353969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-var-lib-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggwqb\" (UniqueName: \"kubernetes.io/projected/c4e8027c-edf2-41f5-92e8-5d604198d923-kube-api-access-ggwqb\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08115717-84e7-414c-83ed-812ce8a9e66f-host\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08115717-84e7-414c-83ed-812ce8a9e66f-serviceca\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9770693f-e51a-468f-b045-d9ba60e87abe-agent-certs\") pod \"konnectivity-agent-tzdhs\" (UID: \"9770693f-e51a-468f-b045-d9ba60e87abe\") " pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-cni-multus\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-multus-certs\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.354208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ppmn\" (UniqueName: \"kubernetes.io/projected/08115717-84e7-414c-83ed-812ce8a9e66f-kube-api-access-2ppmn\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-system-cni-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-os-release\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-netns\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-conf-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354342 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-node-log\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-cni-netd\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-kubelet\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-etc-kubernetes\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-slash\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-etc-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.354703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.354518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-env-overrides\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.355216 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.355074 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m4kmm\"" Jul 09 04:32:01.355216 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.355074 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 04:32:01.355216 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.355106 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 04:32:01.355504 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.355487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.357878 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.357659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.357878 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.357778 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.357878 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.357857 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 04:32:01.360368 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.358205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:01.360368 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.358309 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:01.360368 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.358762 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8lkvv\"" Jul 09 04:32:01.361641 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.361615 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.363744 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.363703 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:01.363897 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.363881 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 04:32:01.364003 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.363988 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:01.364126 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.364112 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lgtgv\"" Jul 09 04:32:01.374669 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.374618 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdw27" Jul 09 04:32:01.382893 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.382871 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pdw27" Jul 09 04:32:01.440082 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.440015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" event={"ID":"acd4d634ee249d4b487dddc3a283d199","Type":"ContainerStarted","Data":"05c72462121f48aabfaeae29ec3b906f2b650c4956a7329f3865870da73c5301"} Jul 09 04:32:01.441121 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.441099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerStarted","Data":"60d1e0bb23fe1e0da35aa6c4857521424ee9cc94490554812a67fd21f6780b2d"} Jul 09 04:32:01.444559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.444545 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 04:32:01.455452 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-slash\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455572 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-etc-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455572 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-ovnkube-script-lib\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455572 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-slash\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-cni-bin\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.455713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455596 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-etc-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-iptables-alerter-script\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.455713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-cni-bin\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.455930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysctl-conf\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.455930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-systemd-units\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-cnibin\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.455930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455828 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-systemd-units\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.455930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsbk\" (UniqueName: \"kubernetes.io/projected/c02b5c82-03a9-4181-b321-4ce92fb7f767-kube-api-access-4gsbk\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.455930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-cnibin\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.455959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl447\" (UniqueName: \"kubernetes.io/projected/b0abb539-f936-432b-a76a-67e0568edf57-kube-api-access-rl447\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-systemd\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-run\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-sys\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-lib-modules\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-var-lib-kubelet\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-ovn\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9770693f-e51a-468f-b045-d9ba60e87abe-konnectivity-ca\") pod \"konnectivity-agent-tzdhs\" (UID: \"9770693f-e51a-468f-b045-d9ba60e87abe\") " pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-k8s-cni-cncf-io\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456217 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-ovnkube-script-lib\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysconfig\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-ovn\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-kubernetes\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-kubelet\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-k8s-cni-cncf-io\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456492 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-kubelet\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4e8027c-edf2-41f5-92e8-5d604198d923-ovn-node-metrics-cert\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.456615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-kubelet-config\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-var-lib-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggwqb\" (UniqueName: \"kubernetes.io/projected/c4e8027c-edf2-41f5-92e8-5d604198d923-kube-api-access-ggwqb\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9770693f-e51a-468f-b045-d9ba60e87abe-agent-certs\") pod \"konnectivity-agent-tzdhs\" (UID: \"9770693f-e51a-468f-b045-d9ba60e87abe\") " pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-cni-multus\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-var-lib-openvswitch\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9770693f-e51a-468f-b045-d9ba60e87abe-konnectivity-ca\") pod \"konnectivity-agent-tzdhs\" (UID: \"9770693f-e51a-468f-b045-d9ba60e87abe\") " pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-multus-certs\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-multus-certs\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456866 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-cni-multus\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456879 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.456963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-registration-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8jd\" (UniqueName: \"kubernetes.io/projected/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-kube-api-access-5w8jd\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ppmn\" (UniqueName: \"kubernetes.io/projected/08115717-84e7-414c-83ed-812ce8a9e66f-kube-api-access-2ppmn\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-system-cni-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.457086 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:01.457093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-os-release\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457125 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-tmp\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-dbus\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-system-cni-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457217 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-os-release\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-cni-netd\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d889193-5d5b-429f-a351-ffb6fd8001fa-hosts-file\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457303 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-cni-netd\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-os-release\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.457374 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:32:01.957331646 +0000 UTC m=+3.106377207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457420 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-env-overrides\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457469 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c02b5c82-03a9-4181-b321-4ce92fb7f767-cni-binary-copy\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw85b\" (UniqueName: \"kubernetes.io/projected/6d889193-5d5b-429f-a351-ffb6fd8001fa-kube-api-access-rw85b\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.457942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysctl-d\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-log-socket\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-daemon-config\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-socket-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-host\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-log-socket\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-systemd\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-hostroot\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457817 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-hostroot\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4jm\" (UniqueName: \"kubernetes.io/projected/17f4d907-f511-40e2-ab69-e98dce57a67d-kube-api-access-ww4jm\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457832 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-env-overrides\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-run-systemd\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-run-netns\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-cni-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-socket-dir-parent\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-cni-binary-copy\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.458723 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-device-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.457977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-sys-fs\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458000 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-host-slash\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-cni-bin\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c02b5c82-03a9-4181-b321-4ce92fb7f767-cni-binary-copy\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-ovnkube-config\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458112 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-run-netns\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-tuned\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458214 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08115717-84e7-414c-83ed-812ce8a9e66f-host\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-cni-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458228 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-socket-dir-parent\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08115717-84e7-414c-83ed-812ce8a9e66f-serviceca\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-modprobe-d\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-netns\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458315 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-cni-bin\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-conf-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-cnibin\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-daemon-config\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-multus-conf-dir\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-node-log\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458481 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-kubelet\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-etc-kubernetes\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c4e8027c-edf2-41f5-92e8-5d604198d923-node-log\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d889193-5d5b-429f-a351-ffb6fd8001fa-tmp-dir\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-var-lib-kubelet\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-system-cni-dir\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458641 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-etc-kubernetes\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4vh\" (UniqueName: \"kubernetes.io/projected/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-kube-api-access-rk4vh\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c02b5c82-03a9-4181-b321-4ce92fb7f767-host-run-netns\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.459737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458674 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4n2\" (UniqueName: \"kubernetes.io/projected/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-kube-api-access-tr4n2\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.460306 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08115717-84e7-414c-83ed-812ce8a9e66f-host\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.460306 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458743 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08115717-84e7-414c-83ed-812ce8a9e66f-serviceca\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.460306 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.458847 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c4e8027c-edf2-41f5-92e8-5d604198d923-ovnkube-config\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.460452 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.460410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c4e8027c-edf2-41f5-92e8-5d604198d923-ovn-node-metrics-cert\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.460452 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.460449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9770693f-e51a-468f-b045-d9ba60e87abe-agent-certs\") pod \"konnectivity-agent-tzdhs\" (UID: \"9770693f-e51a-468f-b045-d9ba60e87abe\") " pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.461935 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.461914 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:32:01.463104 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.463089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsbk\" (UniqueName: \"kubernetes.io/projected/c02b5c82-03a9-4181-b321-4ce92fb7f767-kube-api-access-4gsbk\") pod \"multus-kqsdm\" (UID: \"c02b5c82-03a9-4181-b321-4ce92fb7f767\") " pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.463617 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.463603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggwqb\" (UniqueName: \"kubernetes.io/projected/c4e8027c-edf2-41f5-92e8-5d604198d923-kube-api-access-ggwqb\") pod \"ovnkube-node-w9pzp\" (UID: \"c4e8027c-edf2-41f5-92e8-5d604198d923\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.465782 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.465767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ppmn\" (UniqueName: \"kubernetes.io/projected/08115717-84e7-414c-83ed-812ce8a9e66f-kube-api-access-2ppmn\") pod \"node-ca-mckk4\" (UID: \"08115717-84e7-414c-83ed-812ce8a9e66f\") " pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.471321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.471281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4jm\" (UniqueName: \"kubernetes.io/projected/17f4d907-f511-40e2-ab69-e98dce57a67d-kube-api-access-ww4jm\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.559873 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-registration-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.559873 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8jd\" (UniqueName: \"kubernetes.io/projected/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-kube-api-access-5w8jd\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.559873 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-tmp\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.559873 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-dbus\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d889193-5d5b-429f-a351-ffb6fd8001fa-hosts-file\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-os-release\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw85b\" (UniqueName: \"kubernetes.io/projected/6d889193-5d5b-429f-a351-ffb6fd8001fa-kube-api-access-rw85b\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysctl-d\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560026 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-dbus\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d889193-5d5b-429f-a351-ffb6fd8001fa-hosts-file\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-socket-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.559963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-registration-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-os-release\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-host\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560147 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-cni-binary-copy\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-device-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560195 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-sys-fs\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysctl-d\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-host-slash\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-socket-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-host\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-tuned\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-sys-fs\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-modprobe-d\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-cnibin\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-host-slash\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560495 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d889193-5d5b-429f-a351-ffb6fd8001fa-tmp-dir\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.560519 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-modprobe-d\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.560854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-device-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-system-cni-dir\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-cnibin\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.560587 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:02.060570189 +0000 UTC m=+3.209615736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4vh\" (UniqueName: \"kubernetes.io/projected/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-kube-api-access-rk4vh\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0abb539-f936-432b-a76a-67e0568edf57-system-cni-dir\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4n2\" (UniqueName: \"kubernetes.io/projected/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-kube-api-access-tr4n2\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-iptables-alerter-script\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysctl-conf\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560704 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-cni-binary-copy\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl447\" (UniqueName: \"kubernetes.io/projected/b0abb539-f936-432b-a76a-67e0568edf57-kube-api-access-rl447\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-systemd\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-run\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.561752 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560937 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysctl-conf\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-sys\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-lib-modules\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-systemd\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-var-lib-kubelet\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561019 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-run\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysconfig\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.560957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d889193-5d5b-429f-a351-ffb6fd8001fa-tmp-dir\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-kubernetes\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-var-lib-kubelet\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-kubelet-config\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-sys\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-lib-modules\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-sysconfig\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-kubernetes\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-kubelet-config\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:01.562462 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-iptables-alerter-script\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.563391 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.561636 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0abb539-f936-432b-a76a-67e0568edf57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.563391 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.562413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-tmp\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.563391 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.562967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-etc-tuned\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.569981 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.569716 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:01.569981 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.569738 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:01.569981 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.569752 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:01.569981 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.569818 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:02.069795902 +0000 UTC m=+3.218841453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:01.570906 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.570854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4vh\" (UniqueName: \"kubernetes.io/projected/5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6-kube-api-access-rk4vh\") pod \"iptables-alerter-hrjm6\" (UID: \"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6\") " pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.570906 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.570894 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8jd\" (UniqueName: \"kubernetes.io/projected/a87fa0a6-cc1c-4a44-ac69-ce9534c839b3-kube-api-access-5w8jd\") pod \"aws-ebs-csi-driver-node-zwtl5\" (UID: \"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.571817 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.571461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl447\" (UniqueName: \"kubernetes.io/projected/b0abb539-f936-432b-a76a-67e0568edf57-kube-api-access-rl447\") pod \"multus-additional-cni-plugins-d9mmb\" (UID: \"b0abb539-f936-432b-a76a-67e0568edf57\") " pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.571817 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.571773 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw85b\" (UniqueName: \"kubernetes.io/projected/6d889193-5d5b-429f-a351-ffb6fd8001fa-kube-api-access-rw85b\") pod \"node-resolver-8rg6r\" (UID: \"6d889193-5d5b-429f-a351-ffb6fd8001fa\") " pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.572317 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.572297 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4n2\" (UniqueName: \"kubernetes.io/projected/41af23df-d6fd-479b-9e14-b5cb3c66b3f2-kube-api-access-tr4n2\") pod \"tuned-bcjmx\" (UID: \"41af23df-d6fd-479b-9e14-b5cb3c66b3f2\") " pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.646245 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.646214 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mckk4" Jul 09 04:32:01.652497 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.652477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:01.657085 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.657062 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08115717_84e7_414c_83ed_812ce8a9e66f.slice/crio-c1bb047139c93a54e036801f8c6a9db0bfafe6350e8de43224c382d967dcd15e WatchSource:0}: Error finding container c1bb047139c93a54e036801f8c6a9db0bfafe6350e8de43224c382d967dcd15e: Status 404 returned error can't find the container with id c1bb047139c93a54e036801f8c6a9db0bfafe6350e8de43224c382d967dcd15e Jul 09 04:32:01.662146 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.662125 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqsdm" Jul 09 04:32:01.663246 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.663222 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9770693f_e51a_468f_b045_d9ba60e87abe.slice/crio-704f9a71cea1421580a4292850e7e9ce97cc7986d8e6bbf728cf47f83813f525 WatchSource:0}: Error finding container 704f9a71cea1421580a4292850e7e9ce97cc7986d8e6bbf728cf47f83813f525: Status 404 returned error can't find the container with id 704f9a71cea1421580a4292850e7e9ce97cc7986d8e6bbf728cf47f83813f525 Jul 09 04:32:01.666321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.666304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:01.672351 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.672327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" Jul 09 04:32:01.673826 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.673803 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02b5c82_03a9_4181_b321_4ce92fb7f767.slice/crio-57fa1e07be5270d3504070a6ba6fd4321305cfb5a5167644671592d2ba0cf8e2 WatchSource:0}: Error finding container 57fa1e07be5270d3504070a6ba6fd4321305cfb5a5167644671592d2ba0cf8e2: Status 404 returned error can't find the container with id 57fa1e07be5270d3504070a6ba6fd4321305cfb5a5167644671592d2ba0cf8e2 Jul 09 04:32:01.676483 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.676463 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e8027c_edf2_41f5_92e8_5d604198d923.slice/crio-1a920f2aa7dcb498f17201cb07a772a234728dc6afffd5a0762fb240ea1d55c2 WatchSource:0}: Error finding container 1a920f2aa7dcb498f17201cb07a772a234728dc6afffd5a0762fb240ea1d55c2: Status 404 returned error can't find the container with id 1a920f2aa7dcb498f17201cb07a772a234728dc6afffd5a0762fb240ea1d55c2 Jul 09 04:32:01.677102 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.677081 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8rg6r" Jul 09 04:32:01.682608 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.682571 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41af23df_d6fd_479b_9e14_b5cb3c66b3f2.slice/crio-bcd48c502cde03c91e89a6d4071432e2d4ffc4b24a7e74cd88c43dcf85cda376 WatchSource:0}: Error finding container bcd48c502cde03c91e89a6d4071432e2d4ffc4b24a7e74cd88c43dcf85cda376: Status 404 returned error can't find the container with id bcd48c502cde03c91e89a6d4071432e2d4ffc4b24a7e74cd88c43dcf85cda376 Jul 09 04:32:01.682919 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.682907 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" Jul 09 04:32:01.686210 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.686194 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d889193_5d5b_429f_a351_ffb6fd8001fa.slice/crio-51bdc5c4a8c7e36bbddd1bfeebf69af6c0e2c070a9504a855b54baa20efd358e WatchSource:0}: Error finding container 51bdc5c4a8c7e36bbddd1bfeebf69af6c0e2c070a9504a855b54baa20efd358e: Status 404 returned error can't find the container with id 51bdc5c4a8c7e36bbddd1bfeebf69af6c0e2c070a9504a855b54baa20efd358e Jul 09 04:32:01.687898 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.687878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" Jul 09 04:32:01.690943 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.690918 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0abb539_f936_432b_a76a_67e0568edf57.slice/crio-890445985d943dfe744bdd1166139a04195158bc0f6e464d1cce51ac2c4ffcd5 WatchSource:0}: Error finding container 890445985d943dfe744bdd1166139a04195158bc0f6e464d1cce51ac2c4ffcd5: Status 404 returned error can't find the container with id 890445985d943dfe744bdd1166139a04195158bc0f6e464d1cce51ac2c4ffcd5 Jul 09 04:32:01.693486 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.693466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hrjm6" Jul 09 04:32:01.696271 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.696253 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87fa0a6_cc1c_4a44_ac69_ce9534c839b3.slice/crio-31e3fef52a383c6b7b6c1172c5f9154ba064c8295366986af379ddb874a6c142 WatchSource:0}: Error finding container 31e3fef52a383c6b7b6c1172c5f9154ba064c8295366986af379ddb874a6c142: Status 404 returned error can't find the container with id 31e3fef52a383c6b7b6c1172c5f9154ba064c8295366986af379ddb874a6c142 Jul 09 04:32:01.702370 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:01.702346 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8a0d9d_bb53_4a5c_bf73_0fd32e9bb3b6.slice/crio-31aba876712656fbe1a9d72cd0152279a29108ad8042b467d3436eda3b7c0f57 WatchSource:0}: Error finding container 31aba876712656fbe1a9d72cd0152279a29108ad8042b467d3436eda3b7c0f57: Status 404 returned error can't find the container with id 31aba876712656fbe1a9d72cd0152279a29108ad8042b467d3436eda3b7c0f57 Jul 09 04:32:01.963733 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:01.963699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:01.963922 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.963824 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:01.963922 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:01.963883 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:32:02.963865091 +0000 UTC m=+4.112910642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:02.064713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.064588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:02.064872 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.064778 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:02.064872 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.064854 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:03.064834294 +0000 UTC m=+4.213879844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:02.165995 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.165960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:02.166148 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.166131 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:02.166218 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.166150 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:02.166218 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.166162 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:02.166331 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.166219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:03.166199692 +0000 UTC m=+4.315245260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:02.385932 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.385889 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 04:27:01 +0000 UTC" deadline="2028-04-08 08:02:31.87386949 +0000 UTC" Jul 09 04:32:02.385932 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.385928 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15339h30m29.487945548s" Jul 09 04:32:02.449321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.449258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqsdm" event={"ID":"c02b5c82-03a9-4181-b321-4ce92fb7f767","Type":"ContainerStarted","Data":"57fa1e07be5270d3504070a6ba6fd4321305cfb5a5167644671592d2ba0cf8e2"} Jul 09 04:32:02.453128 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.453093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrjm6" event={"ID":"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6","Type":"ContainerStarted","Data":"31aba876712656fbe1a9d72cd0152279a29108ad8042b467d3436eda3b7c0f57"} Jul 09 04:32:02.455316 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.455272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerStarted","Data":"890445985d943dfe744bdd1166139a04195158bc0f6e464d1cce51ac2c4ffcd5"} Jul 09 04:32:02.457173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.457123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" event={"ID":"41af23df-d6fd-479b-9e14-b5cb3c66b3f2","Type":"ContainerStarted","Data":"bcd48c502cde03c91e89a6d4071432e2d4ffc4b24a7e74cd88c43dcf85cda376"} Jul 09 04:32:02.460909 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.460798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"1a920f2aa7dcb498f17201cb07a772a234728dc6afffd5a0762fb240ea1d55c2"} Jul 09 04:32:02.463124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.463058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzdhs" event={"ID":"9770693f-e51a-468f-b045-d9ba60e87abe","Type":"ContainerStarted","Data":"704f9a71cea1421580a4292850e7e9ce97cc7986d8e6bbf728cf47f83813f525"} Jul 09 04:32:02.464645 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.464618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mckk4" event={"ID":"08115717-84e7-414c-83ed-812ce8a9e66f","Type":"ContainerStarted","Data":"c1bb047139c93a54e036801f8c6a9db0bfafe6350e8de43224c382d967dcd15e"} Jul 09 04:32:02.467644 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.467617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" event={"ID":"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3","Type":"ContainerStarted","Data":"31e3fef52a383c6b7b6c1172c5f9154ba064c8295366986af379ddb874a6c142"} Jul 09 04:32:02.469794 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.469773 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8rg6r" event={"ID":"6d889193-5d5b-429f-a351-ffb6fd8001fa","Type":"ContainerStarted","Data":"51bdc5c4a8c7e36bbddd1bfeebf69af6c0e2c070a9504a855b54baa20efd358e"} Jul 09 04:32:02.971867 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:02.971742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:02.972051 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.971941 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:02.972051 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:02.972022 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:32:04.972001392 +0000 UTC m=+6.121046942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:03.072844 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.072715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:03.073005 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.072936 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:03.073005 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.072999 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:05.072980759 +0000 UTC m=+6.222026338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:03.174042 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.174006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:03.174230 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.174211 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:03.174355 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.174242 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:03.174355 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.174257 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:03.174355 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.174333 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:05.17431471 +0000 UTC m=+6.323360276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:03.387003 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.386938 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 04:27:01 +0000 UTC" deadline="2028-02-24 18:04:09.050475839 +0000 UTC" Jul 09 04:32:03.387003 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.387001 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14293h32m5.66347871s" Jul 09 04:32:03.437971 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.437941 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:03.438126 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.438075 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:03.438204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.438171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:03.438344 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.438317 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:03.438412 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:03.437945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:03.438470 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:03.438423 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:04.990789 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:04.990745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:04.991263 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:04.990895 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:04.991263 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:04.990956 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:32:08.990937767 +0000 UTC m=+10.139983320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:05.091158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:05.091120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:05.091351 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.091336 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:05.091428 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.091403 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:09.091385524 +0000 UTC m=+10.240431077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:05.192300 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:05.191613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:05.192300 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.191832 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:05.192300 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.191853 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:05.192300 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.191866 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:05.192300 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.191923 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:09.191904366 +0000 UTC m=+10.340949916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:05.440373 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:05.439612 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:05.440373 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.439746 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:05.440373 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:05.439822 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:05.440373 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.439889 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:05.440373 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:05.439932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:05.440373 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:05.440009 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:07.437351 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:07.437305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:07.437351 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:07.437305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:07.437748 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:07.437323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:07.437748 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:07.437440 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:07.437748 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:07.437492 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:07.437748 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:07.437573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:09.023632 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:09.023596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:09.024090 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.023779 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:09.024090 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.023840 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:32:17.023822288 +0000 UTC m=+18.172867835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:09.124639 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:09.124601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:09.124805 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.124786 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:09.124871 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.124847 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:17.124829341 +0000 UTC m=+18.273874891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:09.225448 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:09.225369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:09.225623 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.225479 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:09.225623 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.225499 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:09.225623 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.225512 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:09.225623 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.225572 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:17.225553839 +0000 UTC m=+18.374599385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:09.438783 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:09.438067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:09.438783 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.438170 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:09.438783 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:09.438219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:09.438783 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.438316 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:09.438783 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:09.438655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:09.438783 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:09.438743 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:11.437028 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:11.436995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:11.437028 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:11.437037 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:11.437502 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:11.436992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:11.437502 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:11.437136 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:11.437502 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:11.437238 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:11.437502 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:11.437339 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:13.437407 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:13.437376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:13.437877 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:13.437412 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:13.437877 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:13.437376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:13.437877 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:13.437553 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:13.437877 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:13.437693 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:13.437877 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:13.437769 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:13.501085 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:13.500865 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" event={"ID":"acd4d634ee249d4b487dddc3a283d199","Type":"ContainerStarted","Data":"90db30ccc261fe0ee33d8aae496d3056803f2b21e74734d23a10e6f31dec8a33"} Jul 09 04:32:13.502637 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:13.502607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" event={"ID":"41af23df-d6fd-479b-9e14-b5cb3c66b3f2","Type":"ContainerStarted","Data":"973213b64c056c5cc92a6036d13eed9d00c8da475374742ca111230ae98677d5"} Jul 09 04:32:13.517382 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:13.517340 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-255.ec2.internal" podStartSLOduration=13.517327518 podStartE2EDuration="13.517327518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:13.517159543 +0000 UTC m=+14.666205126" watchObservedRunningTime="2026-07-09 04:32:13.517327518 +0000 UTC m=+14.666373090" Jul 09 04:32:14.507306 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.507249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerStarted","Data":"d734875f418a911ab2f026f7c41f6dd5c98aad0405f2979c05741e39e9bc0171"} Jul 09 04:32:14.509587 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.509216 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hrjm6" event={"ID":"5f8a0d9d-bb53-4a5c-bf73-0fd32e9bb3b6","Type":"ContainerStarted","Data":"da03d48ac8f7ce3156fb3beddbcb18d3c9719570648230805b04969de4325896"} Jul 09 04:32:14.511047 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.511020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerStarted","Data":"9d53d72bb10ba56f758b288aed615c7977a58b5dd0a04c90b2b6c1a1d3abca56"} Jul 09 04:32:14.512638 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.512616 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tzdhs" event={"ID":"9770693f-e51a-468f-b045-d9ba60e87abe","Type":"ContainerStarted","Data":"615ad6b710dbae3f2d2545172c656bfffd553b5bc15040d0f1bab19c8af0bffa"} Jul 09 04:32:14.514271 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.514248 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mckk4" event={"ID":"08115717-84e7-414c-83ed-812ce8a9e66f","Type":"ContainerStarted","Data":"7e353d013f2c1974bf65f160ca2c8a63b8d2f0074c02dfe7921a358a30f9afa6"} Jul 09 04:32:14.516121 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.516095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" event={"ID":"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3","Type":"ContainerStarted","Data":"c7e384eaa01864f70cfbeb56a16e3312e251aed1a0284a290b1a44f07a997d5b"} Jul 09 04:32:14.518017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.517995 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8rg6r" event={"ID":"6d889193-5d5b-429f-a351-ffb6fd8001fa","Type":"ContainerStarted","Data":"59ceb2f4b0b632a5cb40fcabc8ee952f4c886f100e5cb00a6ca5fc03c3c5bbd2"} Jul 09 04:32:14.523534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.523491 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bcjmx" podStartSLOduration=4.740420803 podStartE2EDuration="15.523478335s" totalImagesPullingTime="10.783057532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:13.536027302 +0000 UTC m=+14.685072871" watchObservedRunningTime="2026-07-09 04:32:14.523478335 +0000 UTC m=+15.672523903" Jul 09 04:32:14.557702 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.557645 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mckk4" podStartSLOduration=4.7452081 podStartE2EDuration="15.557626847s" totalImagesPullingTime="10.812418747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:14.557541628 +0000 UTC m=+15.706587205" watchObservedRunningTime="2026-07-09 04:32:14.557626847 +0000 UTC m=+15.706672408" Jul 09 04:32:14.594528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.593413 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tzdhs" podStartSLOduration=4.793006601 podStartE2EDuration="15.593396025s" totalImagesPullingTime="10.800389424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:14.575528494 +0000 UTC m=+15.724574075" watchObservedRunningTime="2026-07-09 04:32:14.593396025 +0000 UTC m=+15.742441595" Jul 09 04:32:14.594528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.593783 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8rg6r" podStartSLOduration=4.817578003 podStartE2EDuration="15.593769319s" totalImagesPullingTime="10.776191316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:14.592112443 +0000 UTC m=+15.741158012" watchObservedRunningTime="2026-07-09 04:32:14.593769319 +0000 UTC m=+15.742814888" Jul 09 04:32:14.608527 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:14.608170 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hrjm6" podStartSLOduration=4.886014855 podStartE2EDuration="15.608158128s" totalImagesPullingTime="10.722143273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:14.607761175 +0000 UTC m=+15.756806744" watchObservedRunningTime="2026-07-09 04:32:14.608158128 +0000 UTC m=+15.757203696" Jul 09 04:32:15.119002 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.118963 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:15.119745 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.119721 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:15.437376 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.437305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:15.437514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.437315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:15.437514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.437439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:15.437514 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:15.437432 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:15.437675 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:15.437583 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:15.437726 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:15.437702 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:15.520030 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.519976 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:15.520447 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:15.520406 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tzdhs" Jul 09 04:32:17.086267 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:17.086226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:17.086843 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.086376 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:17.086843 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.086441 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:32:33.086425804 +0000 UTC m=+34.235471356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:17.187083 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:17.187050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:17.187231 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.187174 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:17.187303 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.187234 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:33.187220163 +0000 UTC m=+34.336265711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:17.288156 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:17.288113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:17.288366 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.288310 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:17.288366 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.288334 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:17.288366 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.288344 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:17.288536 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.288399 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:33.288384856 +0000 UTC m=+34.437430407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:17.437273 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:17.437234 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:17.437451 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:17.437244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:17.437451 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:17.437378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:17.437451 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.437393 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:17.437622 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.437468 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:17.437622 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:17.437550 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:18.527429 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:18.527396 2561 generic.go:356] "Generic (PLEG): container finished" podID="fad7ab4e8604dec7835d117ad532794c" containerID="d734875f418a911ab2f026f7c41f6dd5c98aad0405f2979c05741e39e9bc0171" exitCode=0 Jul 09 04:32:18.528121 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:18.527468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerDied","Data":"d734875f418a911ab2f026f7c41f6dd5c98aad0405f2979c05741e39e9bc0171"} Jul 09 04:32:18.529065 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:18.529037 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0abb539-f936-432b-a76a-67e0568edf57" containerID="9d53d72bb10ba56f758b288aed615c7977a58b5dd0a04c90b2b6c1a1d3abca56" exitCode=0 Jul 09 04:32:18.529163 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:18.529072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerDied","Data":"9d53d72bb10ba56f758b288aed615c7977a58b5dd0a04c90b2b6c1a1d3abca56"} Jul 09 04:32:19.437801 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:19.437767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:19.437978 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:19.437863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:19.437978 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:19.437901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:19.437978 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:19.437904 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:19.438144 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:19.437977 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:19.438144 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:19.438051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:21.440795 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:21.440764 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:21.441356 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:21.440807 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:21.441356 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:21.440860 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:21.441356 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:21.440876 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:21.441356 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:21.440957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:21.441356 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:21.441037 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:22.328417 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.328249 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 04:32:22.415190 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.415079 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T04:32:22.328395549Z","UUID":"7f5b2605-bec3-45b3-8d56-4906860e44a3","Handler":null,"Name":"","Endpoint":""} Jul 09 04:32:22.416938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.416914 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 04:32:22.417039 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.416960 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 04:32:22.539357 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.539327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" event={"ID":"fad7ab4e8604dec7835d117ad532794c","Type":"ContainerStarted","Data":"9571ad38fb06e7e6ead76411b005975585ab004abe533f90c82c8f090b8c6fde"} Jul 09 04:32:22.542903 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.542881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"ceb075fd078f3d7306a73065f7eb07289e756340209c6c215abb1cab80a42632"} Jul 09 04:32:22.543013 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.542957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"b81eec852e53222bf7d414a1af4c3923b930345398cb14adac27a0e4a6d7de9b"} Jul 09 04:32:22.543013 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.543009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"8e29ff21c41ce6c6ff28056b4dc84fe13f61a97fd1be3f2d083d44ce820c2b62"} Jul 09 04:32:22.543121 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.543058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"7c2784751b5adbcf9faba1b250b4fd6fb9bb089a1435a00e2eb1b455cf1d9003"} Jul 09 04:32:22.543121 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.543102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"2a010b355267edbdaf92dfbdbf416593834c502ad66ba9a276f79501cd79deb8"} Jul 09 04:32:22.544916 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.544884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" event={"ID":"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3","Type":"ContainerStarted","Data":"e667ea8cf089a80bb94f9f5aed5555a0f64f25033d8f34f901f1a45411069cc0"} Jul 09 04:32:22.546793 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.546765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqsdm" event={"ID":"c02b5c82-03a9-4181-b321-4ce92fb7f767","Type":"ContainerStarted","Data":"ddc9d7146252e0215f557842c7e02f362d0081f478e38c292d2381c83e0a913e"} Jul 09 04:32:22.571042 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.570998 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-255.ec2.internal" podStartSLOduration=22.570986705 podStartE2EDuration="22.570986705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:22.55510759 +0000 UTC m=+23.704153159" watchObservedRunningTime="2026-07-09 04:32:22.570986705 +0000 UTC m=+23.720032273" Jul 09 04:32:22.571212 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:22.571183 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kqsdm" podStartSLOduration=3.112879915 podStartE2EDuration="23.571173737s" totalImagesPullingTime="20.458293822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:22.570837476 +0000 UTC m=+23.719883036" watchObservedRunningTime="2026-07-09 04:32:22.571173737 +0000 UTC m=+23.720219307" Jul 09 04:32:23.441965 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:23.441731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:23.442137 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:23.442075 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:23.442137 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:23.441792 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:23.442251 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:23.442163 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:23.442251 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:23.441787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:23.442251 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:23.442239 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:23.551994 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:23.551967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"af03792a7d29451683fa898af953e462803b49be27a0d9402cb12eb098188d16"} Jul 09 04:32:24.556083 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:24.556052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" event={"ID":"a87fa0a6-cc1c-4a44-ac69-ce9534c839b3","Type":"ContainerStarted","Data":"fb18fe3925444a954f21dd94a139df43f342ae15dffd49176f141f523818bc81"} Jul 09 04:32:24.577406 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:24.577351 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zwtl5" podStartSLOduration=5.104106983 podStartE2EDuration="25.577332631s" totalImagesPullingTime="20.473225648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:24.577165863 +0000 UTC m=+25.726211432" watchObservedRunningTime="2026-07-09 04:32:24.577332631 +0000 UTC m=+25.726378202" Jul 09 04:32:25.437030 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:25.436996 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:25.437030 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:25.437028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:25.437267 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:25.437006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:25.437267 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:25.437111 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:25.437267 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:25.437176 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:25.437267 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:25.437250 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:25.560632 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:25.560601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"d3f524b99b61e74e79a3ec81a1b75375c5c896a21b053fb9c40d2c2c8a82f5b3"} Jul 09 04:32:27.440988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:27.440954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:27.441422 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:27.440954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:27.441422 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:27.441088 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:27.441422 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:27.440954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:27.441422 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:27.441160 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:27.441422 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:27.441256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:28.570303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:28.570222 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" event={"ID":"c4e8027c-edf2-41f5-92e8-5d604198d923","Type":"ContainerStarted","Data":"343b6239236ffecf0d9ffec4af6568e2e196e6876d9aecb881b1e04aec99e5ad"} Jul 09 04:32:28.570895 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:28.570491 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:28.586072 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:28.585929 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:28.595145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:28.595091 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" podStartSLOduration=9.140400713 podStartE2EDuration="29.595072408s" totalImagesPullingTime="20.454671695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:28.594042817 +0000 UTC m=+29.743088386" watchObservedRunningTime="2026-07-09 04:32:28.595072408 +0000 UTC m=+29.744117979" Jul 09 04:32:29.437754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.437723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:29.437948 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:29.437808 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:29.437948 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.437896 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:29.438041 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:29.438018 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:29.438087 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.438055 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:29.438171 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:29.438150 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:29.573401 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.573373 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0abb539-f936-432b-a76a-67e0568edf57" containerID="6ac2ef9460098919871803d2ef06f8f5075af13e691aefed152b47db595b61ee" exitCode=0 Jul 09 04:32:29.573753 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.573448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerDied","Data":"6ac2ef9460098919871803d2ef06f8f5075af13e691aefed152b47db595b61ee"} Jul 09 04:32:29.573753 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.573623 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:29.573993 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.573978 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:29.588478 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:29.588459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:32:30.372959 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:30.372931 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w4mbf"] Jul 09 04:32:30.373125 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:30.373018 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:30.373125 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:30.373102 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:30.376398 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:30.376372 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lm7kb"] Jul 09 04:32:30.376531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:30.376465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:30.376592 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:30.376556 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:30.377147 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:30.377118 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtqwj"] Jul 09 04:32:30.377245 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:30.377205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:30.377320 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:30.377281 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:31.439979 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:31.439959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:31.440341 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:31.440041 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:31.579850 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:31.579820 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0abb539-f936-432b-a76a-67e0568edf57" containerID="3f6d9585949b6ae3971452870564dcda3546f950745027c52a719a432007df78" exitCode=0 Jul 09 04:32:31.579986 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:31.579883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerDied","Data":"3f6d9585949b6ae3971452870564dcda3546f950745027c52a719a432007df78"} Jul 09 04:32:32.436829 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:32.436804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:32.437041 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:32.436806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:32.437041 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:32.436886 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:32.437041 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:32.436965 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:33.110709 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:33.110638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:33.111063 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.110736 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:33.111063 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.110832 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs podName:17f4d907-f511-40e2-ab69-e98dce57a67d nodeName:}" failed. No retries permitted until 2026-07-09 04:33:05.11081439 +0000 UTC m=+66.259859936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs") pod "network-metrics-daemon-gtqwj" (UID: "17f4d907-f511-40e2-ab69-e98dce57a67d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:32:33.211495 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:33.211469 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:33.211630 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.211568 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:33.211630 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.211611 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret podName:85d0abb1-ac9c-45ca-a4bf-548bc3b3a052 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:05.211600373 +0000 UTC m=+66.360645919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret") pod "global-pull-secret-syncer-lm7kb" (UID: "85d0abb1-ac9c-45ca-a4bf-548bc3b3a052") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:32:33.311942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:33.311919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:33.312071 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.312054 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:32:33.312113 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.312078 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:32:33.312113 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.312088 2561 projected.go:196] Error preparing data for projected volume kube-api-access-z2stw for pod openshift-network-diagnostics/network-check-target-w4mbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:33.312184 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.312130 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw podName:b2182d39-dbbf-476f-a4d2-664e7bcc8539 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:05.312117875 +0000 UTC m=+66.461163427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2stw" (UniqueName: "kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw") pod "network-check-target-w4mbf" (UID: "b2182d39-dbbf-476f-a4d2-664e7bcc8539") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:32:33.436737 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:33.436719 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:33.436864 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:33.436808 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w4mbf" podUID="b2182d39-dbbf-476f-a4d2-664e7bcc8539" Jul 09 04:32:34.437704 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.437673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:34.438117 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.437673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:34.438117 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.437776 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtqwj" podUID="17f4d907-f511-40e2-ab69-e98dce57a67d" Jul 09 04:32:34.438117 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.437843 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lm7kb" podUID="85d0abb1-ac9c-45ca-a4bf-548bc3b3a052" Jul 09 04:32:34.652663 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.652512 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-255.ec2.internal" event="NodeReady" Jul 09 04:32:34.652765 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.652744 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 04:32:34.686553 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.686531 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c7b4db4ff-xf6rv"] Jul 09 04:32:34.706378 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.706325 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w"] Jul 09 04:32:34.706470 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.706452 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.708928 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.708909 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 04:32:34.709022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.708917 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8hcw8\"" Jul 09 04:32:34.709022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.708950 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 04:32:34.709022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.708928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 04:32:34.718872 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.718850 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 04:32:34.724330 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.724312 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k"] Jul 09 04:32:34.724438 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.724362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:34.726866 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.726829 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 04:32:34.726961 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.726864 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.726961 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.726915 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4zhnf\"" Jul 09 04:32:34.727051 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.726990 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.744303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.744261 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb"] Jul 09 04:32:34.744416 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.744401 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.746993 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.746974 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.747107 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.746998 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 04:32:34.747107 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.747017 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.747107 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.747071 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2ztd4\"" Jul 09 04:32:34.747107 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.746975 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 04:32:34.768394 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.768378 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mq946"] Jul 09 04:32:34.768518 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.768505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" Jul 09 04:32:34.770974 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.770957 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-82sn2\"" Jul 09 04:32:34.771059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.771015 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.771059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.771022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.784423 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.784402 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7"] Jul 09 04:32:34.784518 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.784505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.786913 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.786896 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 04:32:34.787003 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.786953 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-l74m7\"" Jul 09 04:32:34.787003 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.786978 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.787230 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.787214 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 04:32:34.787473 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.787461 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.792527 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.792512 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 04:32:34.798652 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.798633 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6"] Jul 09 04:32:34.798818 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.798737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:34.801252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.801238 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tkhqc\"" Jul 09 04:32:34.801771 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.801757 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 04:32:34.801835 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.801784 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 04:32:34.802058 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.802040 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.802382 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.802369 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.818846 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.818830 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb"] Jul 09 04:32:34.818930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.818856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c7b4db4ff-xf6rv"] Jul 09 04:32:34.818930 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.818873 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7ct9c"] Jul 09 04:32:34.819003 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.818934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:34.821440 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821423 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jzfkq\"" Jul 09 04:32:34.821612 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgcjx\" (UniqueName: \"kubernetes.io/projected/75026161-92e3-421c-9087-a6f2ca6a9075-kube-api-access-pgcjx\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:34.821740 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e60c6c3f-e7de-4e9e-852c-43b067909a3a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.821740 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821679 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.821740 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-installation-pull-secrets\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.821740 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:34.821915 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e60c6c3f-e7de-4e9e-852c-43b067909a3a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.821915 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.821915 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqxf\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-kube-api-access-8jqxf\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.821915 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-bound-sa-token\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.821915 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmnp\" (UniqueName: \"kubernetes.io/projected/e60c6c3f-e7de-4e9e-852c-43b067909a3a-kube-api-access-xwmnp\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.822080 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-image-registry-private-configuration\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.822080 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-certificates\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.822080 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a18de6dc-65e5-48fb-b423-888b7fe8bacf-ca-trust-extracted\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.822080 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.821998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-trusted-ca\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.822391 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.822371 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.822461 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.822407 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 04:32:34.822514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.822504 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 04:32:34.840819 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.840800 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w"] Jul 09 04:32:34.840892 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.840827 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qnsxd"] Jul 09 04:32:34.840931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.840914 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:34.843211 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.843197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gm2w5\"" Jul 09 04:32:34.843328 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.843229 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.843560 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.843545 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 04:32:34.843636 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.843582 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 04:32:34.843636 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.843609 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.849280 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.849262 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 04:32:34.857406 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.857367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k"] Jul 09 04:32:34.857487 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.857430 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7"] Jul 09 04:32:34.857487 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.857476 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw"] Jul 09 04:32:34.858343 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.858302 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:34.861054 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.861035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 04:32:34.861190 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.861173 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 04:32:34.861307 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.861278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-58ffk\"" Jul 09 04:32:34.882943 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.882923 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rj6pn"] Jul 09 04:32:34.883050 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.882997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" Jul 09 04:32:34.885540 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.885520 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dgxs9\"" Jul 09 04:32:34.885662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.885521 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.885662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.885588 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.907313 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.907296 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr"] Jul 09 04:32:34.907425 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.907409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:34.910154 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.910131 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.910258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.910195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.910258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.910205 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 04:32:34.910368 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.910275 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9rkp9\"" Jul 09 04:32:34.922486 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-image-registry-private-configuration\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.922579 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d37e4720-8db5-42fa-a34f-7eba60e6b08d-serving-cert\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.922579 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-trusted-ca\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.922579 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37e4720-8db5-42fa-a34f-7eba60e6b08d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjj6\" (UniqueName: \"kubernetes.io/projected/d37e4720-8db5-42fa-a34f-7eba60e6b08d-kube-api-access-nbjj6\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e60c6c3f-e7de-4e9e-852c-43b067909a3a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-bound-sa-token\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922654 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgcjx\" (UniqueName: \"kubernetes.io/projected/75026161-92e3-421c-9087-a6f2ca6a9075-kube-api-access-pgcjx\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e60c6c3f-e7de-4e9e-852c-43b067909a3a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.922742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e50bb80-b6ba-408d-9101-6ae231296d9b-config\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922806 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36eea080-9d43-4068-a0d7-56d3c561d0d9-trusted-ca\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37e4720-8db5-42fa-a34f-7eba60e6b08d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e50bb80-b6ba-408d-9101-6ae231296d9b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36eea080-9d43-4068-a0d7-56d3c561d0d9-config\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.922921 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.922936 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7b4db4ff-xf6rv: secret "image-registry-tls" not found Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.922988 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls podName:a18de6dc-65e5-48fb-b423-888b7fe8bacf nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.422972218 +0000 UTC m=+36.572017779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls") pod "image-registry-c7b4db4ff-xf6rv" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf") : secret "image-registry-tls" not found Jul 09 04:32:34.923046 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.922921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-certificates\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a18de6dc-65e5-48fb-b423-888b7fe8bacf-ca-trust-extracted\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzv9b\" (UniqueName: \"kubernetes.io/projected/36eea080-9d43-4068-a0d7-56d3c561d0d9-kube-api-access-vzv9b\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrn6v\" (UniqueName: \"kubernetes.io/projected/04ef2507-0028-4bf0-b01d-c19acd7e7e81-kube-api-access-xrn6v\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-installation-pull-secrets\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923259 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e60c6c3f-e7de-4e9e-852c-43b067909a3a-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923399 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqxf\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-kube-api-access-8jqxf\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-certificates\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d37e4720-8db5-42fa-a34f-7eba60e6b08d-snapshots\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36eea080-9d43-4068-a0d7-56d3c561d0d9-serving-cert\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a18de6dc-65e5-48fb-b423-888b7fe8bacf-ca-trust-extracted\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hwg\" (UniqueName: \"kubernetes.io/projected/629f4a2b-a417-4371-8b4f-988f1dbafb2f-kube-api-access-v5hwg\") pod \"volume-data-source-validator-5d456fdbcd-hmksb\" (UID: \"629f4a2b-a417-4371-8b4f-988f1dbafb2f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-trusted-ca\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/04ef2507-0028-4bf0-b01d-c19acd7e7e81-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.923607 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d37e4720-8db5-42fa-a34f-7eba60e6b08d-tmp\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:34.923658 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls podName:75026161-92e3-421c-9087-a6f2ca6a9075 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.423644095 +0000 UTC m=+36.572689641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2dt8w" (UID: "75026161-92e3-421c-9087-a6f2ca6a9075") : secret "samples-operator-tls" not found Jul 09 04:32:34.923786 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9lvv\" (UniqueName: \"kubernetes.io/projected/8e50bb80-b6ba-408d-9101-6ae231296d9b-kube-api-access-z9lvv\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:34.924612 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.923714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmnp\" (UniqueName: \"kubernetes.io/projected/e60c6c3f-e7de-4e9e-852c-43b067909a3a-kube-api-access-xwmnp\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.927702 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.927472 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58fffb79c5-wh6w7"] Jul 09 04:32:34.927702 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.927646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e60c6c3f-e7de-4e9e-852c-43b067909a3a-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.927702 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.927663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-image-registry-private-configuration\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.927702 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.927664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-installation-pull-secrets\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.927961 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.927811 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:34.929966 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.929943 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 04:32:34.930068 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.930030 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 04:32:34.930618 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.930415 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dnlc2\"" Jul 09 04:32:34.931634 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.931612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-bound-sa-token\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.931942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.931924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgcjx\" (UniqueName: \"kubernetes.io/projected/75026161-92e3-421c-9087-a6f2ca6a9075-kube-api-access-pgcjx\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:34.932017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.931933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqxf\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-kube-api-access-8jqxf\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:34.932017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.931952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmnp\" (UniqueName: \"kubernetes.io/projected/e60c6c3f-e7de-4e9e-852c-43b067909a3a-kube-api-access-xwmnp\") pod \"kube-storage-version-migrator-operator-846bf668f7-wsd9k\" (UID: \"e60c6c3f-e7de-4e9e-852c-43b067909a3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:34.961801 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961755 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6"] Jul 09 04:32:34.961801 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961780 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw"] Jul 09 04:32:34.961801 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961794 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7ct9c"] Jul 09 04:32:34.961931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961806 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr"] Jul 09 04:32:34.961931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961818 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qnsxd"] Jul 09 04:32:34.961931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961832 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mq946"] Jul 09 04:32:34.961931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961843 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58fffb79c5-wh6w7"] Jul 09 04:32:34.961931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961858 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rj6pn"] Jul 09 04:32:34.961931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.961867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:34.964441 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 04:32:34.964525 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964482 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 04:32:34.964525 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964480 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 04:32:34.964631 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964531 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 04:32:34.964631 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964486 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 04:32:34.964631 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnhsp\"" Jul 09 04:32:34.964631 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:34.964629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 04:32:35.025721 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9lvv\" (UniqueName: \"kubernetes.io/projected/8e50bb80-b6ba-408d-9101-6ae231296d9b-kube-api-access-z9lvv\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.025821 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d37e4720-8db5-42fa-a34f-7eba60e6b08d-serving-cert\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.025821 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37e4720-8db5-42fa-a34f-7eba60e6b08d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.025821 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjj6\" (UniqueName: \"kubernetes.io/projected/d37e4720-8db5-42fa-a34f-7eba60e6b08d-kube-api-access-nbjj6\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.025821 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfrg\" (UniqueName: \"kubernetes.io/projected/b53eba66-0ab5-452c-b243-3b965ede7fb0-kube-api-access-djfrg\") pod \"network-check-source-989f8b8dc-llhnw\" (UID: \"b53eba66-0ab5-452c-b243-3b965ede7fb0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" Jul 09 04:32:35.025988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:35.025988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfr9\" (UniqueName: \"kubernetes.io/projected/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-kube-api-access-sjfr9\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.025988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e50bb80-b6ba-408d-9101-6ae231296d9b-config\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.025988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36eea080-9d43-4068-a0d7-56d3c561d0d9-trusted-ca\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.025988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-config-volume\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.025988 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.025978 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:35.026261 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.026049 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls podName:04ef2507-0028-4bf0-b01d-c19acd7e7e81 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.526030738 +0000 UTC m=+36.675076304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rj7p6" (UID: "04ef2507-0028-4bf0-b01d-c19acd7e7e81") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:35.026261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.025977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3538224-1512-43c3-9a33-5362ddd714e3-cert\") pod \"ingress-canary-rj6pn\" (UID: \"e3538224-1512-43c3-9a33-5362ddd714e3\") " pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.026261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37e4720-8db5-42fa-a34f-7eba60e6b08d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.026261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e50bb80-b6ba-408d-9101-6ae231296d9b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.026261 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36eea080-9d43-4068-a0d7-56d3c561d0d9-config\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzv9b\" (UniqueName: \"kubernetes.io/projected/36eea080-9d43-4068-a0d7-56d3c561d0d9-kube-api-access-vzv9b\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/101e9068-82b9-47e9-95f3-b56cb5a33923-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrn6v\" (UniqueName: \"kubernetes.io/projected/04ef2507-0028-4bf0-b01d-c19acd7e7e81-kube-api-access-xrn6v\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d37e4720-8db5-42fa-a34f-7eba60e6b08d-snapshots\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36eea080-9d43-4068-a0d7-56d3c561d0d9-serving-cert\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37e4720-8db5-42fa-a34f-7eba60e6b08d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hwg\" (UniqueName: \"kubernetes.io/projected/629f4a2b-a417-4371-8b4f-988f1dbafb2f-kube-api-access-v5hwg\") pod \"volume-data-source-validator-5d456fdbcd-hmksb\" (UID: \"629f4a2b-a417-4371-8b4f-988f1dbafb2f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" Jul 09 04:32:35.026531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e50bb80-b6ba-408d-9101-6ae231296d9b-config\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/04ef2507-0028-4bf0-b01d-c19acd7e7e81-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-tmp-dir\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d37e4720-8db5-42fa-a34f-7eba60e6b08d-tmp\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74n46\" (UniqueName: \"kubernetes.io/projected/e3538224-1512-43c3-9a33-5362ddd714e3-kube-api-access-74n46\") pod \"ingress-canary-rj6pn\" (UID: \"e3538224-1512-43c3-9a33-5362ddd714e3\") " pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36eea080-9d43-4068-a0d7-56d3c561d0d9-trusted-ca\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.026968 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.026955 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37e4720-8db5-42fa-a34f-7eba60e6b08d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.027309 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.027045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d37e4720-8db5-42fa-a34f-7eba60e6b08d-tmp\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.027309 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.027119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36eea080-9d43-4068-a0d7-56d3c561d0d9-config\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.027554 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.027533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/04ef2507-0028-4bf0-b01d-c19acd7e7e81-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:35.027675 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.027659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d37e4720-8db5-42fa-a34f-7eba60e6b08d-snapshots\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.028148 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.028132 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d37e4720-8db5-42fa-a34f-7eba60e6b08d-serving-cert\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.028523 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.028509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e50bb80-b6ba-408d-9101-6ae231296d9b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.028875 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.028861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36eea080-9d43-4068-a0d7-56d3c561d0d9-serving-cert\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.035178 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.035150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hwg\" (UniqueName: \"kubernetes.io/projected/629f4a2b-a417-4371-8b4f-988f1dbafb2f-kube-api-access-v5hwg\") pod \"volume-data-source-validator-5d456fdbcd-hmksb\" (UID: \"629f4a2b-a417-4371-8b4f-988f1dbafb2f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" Jul 09 04:32:35.035260 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.035245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9lvv\" (UniqueName: \"kubernetes.io/projected/8e50bb80-b6ba-408d-9101-6ae231296d9b-kube-api-access-z9lvv\") pod \"service-ca-operator-5d46d9ffd4-jf5g7\" (UID: \"8e50bb80-b6ba-408d-9101-6ae231296d9b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.036310 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.036246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrn6v\" (UniqueName: \"kubernetes.io/projected/04ef2507-0028-4bf0-b01d-c19acd7e7e81-kube-api-access-xrn6v\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:35.036533 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.036515 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjj6\" (UniqueName: \"kubernetes.io/projected/d37e4720-8db5-42fa-a34f-7eba60e6b08d-kube-api-access-nbjj6\") pod \"insights-operator-5c847dcfc4-mq946\" (UID: \"d37e4720-8db5-42fa-a34f-7eba60e6b08d\") " pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.036707 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.036691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzv9b\" (UniqueName: \"kubernetes.io/projected/36eea080-9d43-4068-a0d7-56d3c561d0d9-kube-api-access-vzv9b\") pod \"console-operator-68b757fb67-7ct9c\" (UID: \"36eea080-9d43-4068-a0d7-56d3c561d0d9\") " pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.052357 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.052341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" Jul 09 04:32:35.076308 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.076280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" Jul 09 04:32:35.092440 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.092421 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" Jul 09 04:32:35.106978 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.106959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" Jul 09 04:32:35.127733 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.127830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmxkp\" (UniqueName: \"kubernetes.io/projected/7fe0d56a-70d3-4d82-b608-7205a506c151-kube-api-access-tmxkp\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.127830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfrg\" (UniqueName: \"kubernetes.io/projected/b53eba66-0ab5-452c-b243-3b965ede7fb0-kube-api-access-djfrg\") pod \"network-check-source-989f8b8dc-llhnw\" (UID: \"b53eba66-0ab5-452c-b243-3b965ede7fb0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" Jul 09 04:32:35.127939 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfr9\" (UniqueName: \"kubernetes.io/projected/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-kube-api-access-sjfr9\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.127939 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.127939 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-config-volume\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.128088 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127944 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3538224-1512-43c3-9a33-5362ddd714e3-cert\") pod \"ingress-canary-rj6pn\" (UID: \"e3538224-1512-43c3-9a33-5362ddd714e3\") " pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.128088 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.127999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/101e9068-82b9-47e9-95f3-b56cb5a33923-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:35.128088 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-default-certificate\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.128088 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:35.128269 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.128269 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.128155 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:32:35.128269 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-tmp-dir\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.128269 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.128219 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert podName:101e9068-82b9-47e9-95f3-b56cb5a33923 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.628202067 +0000 UTC m=+36.777247615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-8tlzr" (UID: "101e9068-82b9-47e9-95f3-b56cb5a33923") : secret "networking-console-plugin-cert" not found Jul 09 04:32:35.128269 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74n46\" (UniqueName: \"kubernetes.io/projected/e3538224-1512-43c3-9a33-5362ddd714e3-kube-api-access-74n46\") pod \"ingress-canary-rj6pn\" (UID: \"e3538224-1512-43c3-9a33-5362ddd714e3\") " pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.128527 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-stats-auth\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.128527 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.128466 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:32:35.128527 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128504 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-config-volume\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.128661 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128466 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-tmp-dir\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.128661 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.128552 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls podName:11c5ceb4-0ceb-4004-9f3b-8538736c68fd nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.628499781 +0000 UTC m=+36.777545333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls") pod "dns-default-qnsxd" (UID: "11c5ceb4-0ceb-4004-9f3b-8538736c68fd") : secret "dns-default-metrics-tls" not found Jul 09 04:32:35.128791 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.128771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/101e9068-82b9-47e9-95f3-b56cb5a33923-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:35.130698 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.130675 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3538224-1512-43c3-9a33-5362ddd714e3-cert\") pod \"ingress-canary-rj6pn\" (UID: \"e3538224-1512-43c3-9a33-5362ddd714e3\") " pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.137776 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.137757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfr9\" (UniqueName: \"kubernetes.io/projected/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-kube-api-access-sjfr9\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.137874 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.137814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74n46\" (UniqueName: \"kubernetes.io/projected/e3538224-1512-43c3-9a33-5362ddd714e3-kube-api-access-74n46\") pod \"ingress-canary-rj6pn\" (UID: \"e3538224-1512-43c3-9a33-5362ddd714e3\") " pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.137921 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.137884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfrg\" (UniqueName: \"kubernetes.io/projected/b53eba66-0ab5-452c-b243-3b965ede7fb0-kube-api-access-djfrg\") pod \"network-check-source-989f8b8dc-llhnw\" (UID: \"b53eba66-0ab5-452c-b243-3b965ede7fb0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" Jul 09 04:32:35.148337 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.148317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:35.192432 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.192416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" Jul 09 04:32:35.215269 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.215255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj6pn" Jul 09 04:32:35.229620 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.229577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-stats-auth\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.229701 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.229627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.229701 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.229668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmxkp\" (UniqueName: \"kubernetes.io/projected/7fe0d56a-70d3-4d82-b608-7205a506c151-kube-api-access-tmxkp\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.229812 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.229735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.229812 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.229791 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.729776838 +0000 UTC m=+36.878822388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : configmap references non-existent config key: service-ca.crt Jul 09 04:32:35.229918 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.229839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-default-certificate\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.229918 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.229850 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:32:35.229918 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.229897 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:35.729880895 +0000 UTC m=+36.878926485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : secret "router-metrics-certs-default" not found Jul 09 04:32:35.231706 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.231684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-stats-auth\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.231778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.231751 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-default-certificate\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.238632 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.238612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmxkp\" (UniqueName: \"kubernetes.io/projected/7fe0d56a-70d3-4d82-b608-7205a506c151-kube-api-access-tmxkp\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.434886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.435018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.435218 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.435231 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7b4db4ff-xf6rv: secret "image-registry-tls" not found Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.435311 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls podName:a18de6dc-65e5-48fb-b423-888b7fe8bacf nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.435270449 +0000 UTC m=+37.584316000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls") pod "image-registry-c7b4db4ff-xf6rv" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf") : secret "image-registry-tls" not found Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.435976 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:32:35.436082 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.436029 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls podName:75026161-92e3-421c-9087-a6f2ca6a9075 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.436013017 +0000 UTC m=+37.585058563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2dt8w" (UID: "75026161-92e3-421c-9087-a6f2ca6a9075") : secret "samples-operator-tls" not found Jul 09 04:32:35.444321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.443448 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:32:35.448814 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.448790 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcbs\"" Jul 09 04:32:35.507793 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.507615 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb"] Jul 09 04:32:35.511325 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.511299 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rj6pn"] Jul 09 04:32:35.513966 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:35.513933 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629f4a2b_a417_4371_8b4f_988f1dbafb2f.slice/crio-f283e590e87ab15167eca36bafed8d14c6cdcf26c3030f29a601c57b6b8314e7 WatchSource:0}: Error finding container f283e590e87ab15167eca36bafed8d14c6cdcf26c3030f29a601c57b6b8314e7: Status 404 returned error can't find the container with id f283e590e87ab15167eca36bafed8d14c6cdcf26c3030f29a601c57b6b8314e7 Jul 09 04:32:35.516334 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:35.516262 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3538224_1512_43c3_9a33_5362ddd714e3.slice/crio-d6187df5f563e6041370be2243fe65603c2930f07ba3b83297d9b771581a84fa WatchSource:0}: Error finding container d6187df5f563e6041370be2243fe65603c2930f07ba3b83297d9b771581a84fa: Status 404 returned error can't find the container with id d6187df5f563e6041370be2243fe65603c2930f07ba3b83297d9b771581a84fa Jul 09 04:32:35.522115 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.518695 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-7ct9c"] Jul 09 04:32:35.522115 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.521945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw"] Jul 09 04:32:35.525456 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.525423 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-mq946"] Jul 09 04:32:35.526439 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:35.526379 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53eba66_0ab5_452c_b243_3b965ede7fb0.slice/crio-5fe273eb42e1760134a85c068c7a8e49f89abb2c81d13bfc5cd4f55c4a311498 WatchSource:0}: Error finding container 5fe273eb42e1760134a85c068c7a8e49f89abb2c81d13bfc5cd4f55c4a311498: Status 404 returned error can't find the container with id 5fe273eb42e1760134a85c068c7a8e49f89abb2c81d13bfc5cd4f55c4a311498 Jul 09 04:32:35.528703 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:35.528670 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37e4720_8db5_42fa_a34f_7eba60e6b08d.slice/crio-49b5c05be818ac7983638cb295960b9688e10803c68144da85269c1928f336ac WatchSource:0}: Error finding container 49b5c05be818ac7983638cb295960b9688e10803c68144da85269c1928f336ac: Status 404 returned error can't find the container with id 49b5c05be818ac7983638cb295960b9688e10803c68144da85269c1928f336ac Jul 09 04:32:35.531804 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.531788 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k"] Jul 09 04:32:35.534307 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:35.534259 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60c6c3f_e7de_4e9e_852c_43b067909a3a.slice/crio-0bf6dc112cb862a0070ab2236733513b27aa4557488452026b71bcbde5c35acb WatchSource:0}: Error finding container 0bf6dc112cb862a0070ab2236733513b27aa4557488452026b71bcbde5c35acb: Status 404 returned error can't find the container with id 0bf6dc112cb862a0070ab2236733513b27aa4557488452026b71bcbde5c35acb Jul 09 04:32:35.535541 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.535521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:35.535630 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.535618 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:35.535679 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.535661 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls podName:04ef2507-0028-4bf0-b01d-c19acd7e7e81 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.535644843 +0000 UTC m=+37.684690391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rj7p6" (UID: "04ef2507-0028-4bf0-b01d-c19acd7e7e81") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:35.541747 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.541724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7"] Jul 09 04:32:35.544058 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:32:35.544039 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e50bb80_b6ba_408d_9101_6ae231296d9b.slice/crio-9bf6eb0dafd8f5cc3e80fa0f0e7f7e0d4ab201c70bc2c224195d925958f29b35 WatchSource:0}: Error finding container 9bf6eb0dafd8f5cc3e80fa0f0e7f7e0d4ab201c70bc2c224195d925958f29b35: Status 404 returned error can't find the container with id 9bf6eb0dafd8f5cc3e80fa0f0e7f7e0d4ab201c70bc2c224195d925958f29b35 Jul 09 04:32:35.588798 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.588776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" event={"ID":"e60c6c3f-e7de-4e9e-852c-43b067909a3a","Type":"ContainerStarted","Data":"0bf6dc112cb862a0070ab2236733513b27aa4557488452026b71bcbde5c35acb"} Jul 09 04:32:35.590022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.589999 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" event={"ID":"8e50bb80-b6ba-408d-9101-6ae231296d9b","Type":"ContainerStarted","Data":"9bf6eb0dafd8f5cc3e80fa0f0e7f7e0d4ab201c70bc2c224195d925958f29b35"} Jul 09 04:32:35.591238 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.591217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" event={"ID":"36eea080-9d43-4068-a0d7-56d3c561d0d9","Type":"ContainerStarted","Data":"fb3b53176fa7c60c0946e36b5aaf786586f404a5ffe2df3b267736fda450aaab"} Jul 09 04:32:35.592463 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.592444 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rj6pn" event={"ID":"e3538224-1512-43c3-9a33-5362ddd714e3","Type":"ContainerStarted","Data":"d6187df5f563e6041370be2243fe65603c2930f07ba3b83297d9b771581a84fa"} Jul 09 04:32:35.593432 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.593414 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" event={"ID":"d37e4720-8db5-42fa-a34f-7eba60e6b08d","Type":"ContainerStarted","Data":"49b5c05be818ac7983638cb295960b9688e10803c68144da85269c1928f336ac"} Jul 09 04:32:35.594436 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.594418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" event={"ID":"b53eba66-0ab5-452c-b243-3b965ede7fb0","Type":"ContainerStarted","Data":"5fe273eb42e1760134a85c068c7a8e49f89abb2c81d13bfc5cd4f55c4a311498"} Jul 09 04:32:35.595405 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.595389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" event={"ID":"629f4a2b-a417-4371-8b4f-988f1dbafb2f","Type":"ContainerStarted","Data":"f283e590e87ab15167eca36bafed8d14c6cdcf26c3030f29a601c57b6b8314e7"} Jul 09 04:32:35.636145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.636122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:35.636250 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.636150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:35.636338 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.636249 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:32:35.636338 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.636256 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:32:35.636338 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.636298 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls podName:11c5ceb4-0ceb-4004-9f3b-8538736c68fd nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.636273496 +0000 UTC m=+37.785319042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls") pod "dns-default-qnsxd" (UID: "11c5ceb4-0ceb-4004-9f3b-8538736c68fd") : secret "dns-default-metrics-tls" not found Jul 09 04:32:35.636338 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.636332 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert podName:101e9068-82b9-47e9-95f3-b56cb5a33923 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.636314625 +0000 UTC m=+37.785360195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-8tlzr" (UID: "101e9068-82b9-47e9-95f3-b56cb5a33923") : secret "networking-console-plugin-cert" not found Jul 09 04:32:35.737777 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.737719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.737917 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:35.737864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:35.737917 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.737882 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:32:35.738001 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.737947 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.737930979 +0000 UTC m=+37.886976526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : secret "router-metrics-certs-default" not found Jul 09 04:32:35.738001 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:35.737981 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:36.737968307 +0000 UTC m=+37.887013860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : configmap references non-existent config key: service-ca.crt Jul 09 04:32:36.438222 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.437655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:32:36.438222 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.437869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:32:36.440938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.440913 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 04:32:36.442336 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.441941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bx88j\"" Jul 09 04:32:36.442336 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.442171 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 04:32:36.443276 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.443238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:36.443410 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.443385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:36.444449 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.443611 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:32:36.444449 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.443631 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7b4db4ff-xf6rv: secret "image-registry-tls" not found Jul 09 04:32:36.444449 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.443682 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls podName:a18de6dc-65e5-48fb-b423-888b7fe8bacf nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.443665057 +0000 UTC m=+39.592710618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls") pod "image-registry-c7b4db4ff-xf6rv" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf") : secret "image-registry-tls" not found Jul 09 04:32:36.444449 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.443984 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:32:36.444449 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.444039 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls podName:75026161-92e3-421c-9087-a6f2ca6a9075 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.444023752 +0000 UTC m=+39.593069305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2dt8w" (UID: "75026161-92e3-421c-9087-a6f2ca6a9075") : secret "samples-operator-tls" not found Jul 09 04:32:36.544485 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.544450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:36.545081 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.545059 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:36.545167 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.545125 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls podName:04ef2507-0028-4bf0-b01d-c19acd7e7e81 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.545106593 +0000 UTC m=+39.694152144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rj7p6" (UID: "04ef2507-0028-4bf0-b01d-c19acd7e7e81") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:36.605451 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.605402 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0abb539-f936-432b-a76a-67e0568edf57" containerID="aa2aa5f81ff1f09c35b3d36d8b838ed653f0ca51149414dff9cdf70123b0dea7" exitCode=0 Jul 09 04:32:36.605625 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.605481 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerDied","Data":"aa2aa5f81ff1f09c35b3d36d8b838ed653f0ca51149414dff9cdf70123b0dea7"} Jul 09 04:32:36.645897 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.645866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:36.646037 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.645919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:36.646100 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.646083 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:32:36.646154 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.646141 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert podName:101e9068-82b9-47e9-95f3-b56cb5a33923 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.646124058 +0000 UTC m=+39.795169609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-8tlzr" (UID: "101e9068-82b9-47e9-95f3-b56cb5a33923") : secret "networking-console-plugin-cert" not found Jul 09 04:32:36.646716 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.646642 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:32:36.646716 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.646690 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls podName:11c5ceb4-0ceb-4004-9f3b-8538736c68fd nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.646676984 +0000 UTC m=+39.795722534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls") pod "dns-default-qnsxd" (UID: "11c5ceb4-0ceb-4004-9f3b-8538736c68fd") : secret "dns-default-metrics-tls" not found Jul 09 04:32:36.747788 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.747346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:36.747788 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:36.747472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:36.748845 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.748521 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.748497236 +0000 UTC m=+39.897542797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : configmap references non-existent config key: service-ca.crt Jul 09 04:32:36.749272 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.749174 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:32:36.749272 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:36.749238 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:38.749221644 +0000 UTC m=+39.898267190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : secret "router-metrics-certs-default" not found Jul 09 04:32:38.467195 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.467124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:38.467563 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.467228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:38.467563 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.467272 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:32:38.467563 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.467349 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls podName:75026161-92e3-421c-9087-a6f2ca6a9075 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.467335394 +0000 UTC m=+43.616380946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2dt8w" (UID: "75026161-92e3-421c-9087-a6f2ca6a9075") : secret "samples-operator-tls" not found Jul 09 04:32:38.467563 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.467373 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:32:38.467563 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.467385 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7b4db4ff-xf6rv: secret "image-registry-tls" not found Jul 09 04:32:38.467563 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.467433 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls podName:a18de6dc-65e5-48fb-b423-888b7fe8bacf nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.467419434 +0000 UTC m=+43.616465000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls") pod "image-registry-c7b4db4ff-xf6rv" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf") : secret "image-registry-tls" not found Jul 09 04:32:38.567982 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.567941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:38.568249 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.568095 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:38.568249 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.568170 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls podName:04ef2507-0028-4bf0-b01d-c19acd7e7e81 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.568149128 +0000 UTC m=+43.717194674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rj7p6" (UID: "04ef2507-0028-4bf0-b01d-c19acd7e7e81") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:38.668960 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.668928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:38.669116 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.668967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:38.669172 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.669111 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:32:38.669172 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.669150 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:32:38.669253 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.669192 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert podName:101e9068-82b9-47e9-95f3-b56cb5a33923 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.669170027 +0000 UTC m=+43.818215575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-8tlzr" (UID: "101e9068-82b9-47e9-95f3-b56cb5a33923") : secret "networking-console-plugin-cert" not found Jul 09 04:32:38.669253 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.669212 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls podName:11c5ceb4-0ceb-4004-9f3b-8538736c68fd nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.669201578 +0000 UTC m=+43.818247139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls") pod "dns-default-qnsxd" (UID: "11c5ceb4-0ceb-4004-9f3b-8538736c68fd") : secret "dns-default-metrics-tls" not found Jul 09 04:32:38.770268 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.770186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:38.770437 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:38.770304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:38.770537 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.770515 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:32:38.770597 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.770583 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.77056356 +0000 UTC m=+43.919609110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : secret "router-metrics-certs-default" not found Jul 09 04:32:38.771008 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:38.770992 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:42.770976111 +0000 UTC m=+43.920021675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : configmap references non-existent config key: service-ca.crt Jul 09 04:32:42.505836 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.505790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:42.506341 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.505932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:42.506341 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.505983 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:32:42.506341 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.506052 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:32:42.506341 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.506071 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7b4db4ff-xf6rv: secret "image-registry-tls" not found Jul 09 04:32:42.506341 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.506071 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls podName:75026161-92e3-421c-9087-a6f2ca6a9075 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.506049369 +0000 UTC m=+51.655094916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2dt8w" (UID: "75026161-92e3-421c-9087-a6f2ca6a9075") : secret "samples-operator-tls" not found Jul 09 04:32:42.506341 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.506120 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls podName:a18de6dc-65e5-48fb-b423-888b7fe8bacf nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.506107818 +0000 UTC m=+51.655153368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls") pod "image-registry-c7b4db4ff-xf6rv" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf") : secret "image-registry-tls" not found Jul 09 04:32:42.607193 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.607161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:42.607375 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.607319 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:42.607420 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.607387 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls podName:04ef2507-0028-4bf0-b01d-c19acd7e7e81 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.60736771 +0000 UTC m=+51.756413256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rj7p6" (UID: "04ef2507-0028-4bf0-b01d-c19acd7e7e81") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:42.707969 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.707932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:42.707969 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.707985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:42.708195 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.708095 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:32:42.708195 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.708143 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls podName:11c5ceb4-0ceb-4004-9f3b-8538736c68fd nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.708130911 +0000 UTC m=+51.857176457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls") pod "dns-default-qnsxd" (UID: "11c5ceb4-0ceb-4004-9f3b-8538736c68fd") : secret "dns-default-metrics-tls" not found Jul 09 04:32:42.708195 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.708096 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:32:42.708334 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.708224 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert podName:101e9068-82b9-47e9-95f3-b56cb5a33923 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.708209637 +0000 UTC m=+51.857255184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-8tlzr" (UID: "101e9068-82b9-47e9-95f3-b56cb5a33923") : secret "networking-console-plugin-cert" not found Jul 09 04:32:42.809364 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.809268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:42.809531 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:42.809392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:42.809531 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.809452 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.809432582 +0000 UTC m=+51.958478136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : configmap references non-existent config key: service-ca.crt Jul 09 04:32:42.809654 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.809574 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:32:42.809654 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:42.809650 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.809636422 +0000 UTC m=+51.958681988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : secret "router-metrics-certs-default" not found Jul 09 04:32:45.638303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.635509 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/0.log" Jul 09 04:32:45.638303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.635904 2561 generic.go:356] "Generic (PLEG): container finished" podID="36eea080-9d43-4068-a0d7-56d3c561d0d9" containerID="ffed082cf467514a6feec9fd2a9e42209ac2c7acd2d35c7d3deee26ae1fe4224" exitCode=255 Jul 09 04:32:45.638303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.636299 2561 scope.go:117] "RemoveContainer" containerID="ffed082cf467514a6feec9fd2a9e42209ac2c7acd2d35c7d3deee26ae1fe4224" Jul 09 04:32:45.638303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.636561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" event={"ID":"36eea080-9d43-4068-a0d7-56d3c561d0d9","Type":"ContainerDied","Data":"ffed082cf467514a6feec9fd2a9e42209ac2c7acd2d35c7d3deee26ae1fe4224"} Jul 09 04:32:45.640701 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.639924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rj6pn" event={"ID":"e3538224-1512-43c3-9a33-5362ddd714e3","Type":"ContainerStarted","Data":"9574269cfb15af79753e69e51774209e750342136f37b78fac22b17ba6092c3f"} Jul 09 04:32:45.643300 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.642594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" event={"ID":"d37e4720-8db5-42fa-a34f-7eba60e6b08d","Type":"ContainerStarted","Data":"694083298a211934e2dd68db19b7a7faf863186bb53319c9bba7b46198d43b34"} Jul 09 04:32:45.647027 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.644745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" event={"ID":"b53eba66-0ab5-452c-b243-3b965ede7fb0","Type":"ContainerStarted","Data":"fa4bddf337cac49952d02849bf395db245633b805b24b7a8fa9506eb6f945fce"} Jul 09 04:32:45.647027 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.646657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" event={"ID":"629f4a2b-a417-4371-8b4f-988f1dbafb2f","Type":"ContainerStarted","Data":"c464ddd320fc1caf6e4b51aaaf171bea379cb84e55c47d6349c1e0fe60ae2616"} Jul 09 04:32:45.654565 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.654540 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerStarted","Data":"93958b7bf5703c5e5df026fa893144d14cf910ffa4cbbc750bb85575c63498c3"} Jul 09 04:32:45.657221 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.657190 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" event={"ID":"e60c6c3f-e7de-4e9e-852c-43b067909a3a","Type":"ContainerStarted","Data":"6ab209e7519ed3de348eae26b6bf4a6103bbaea06f8615d77813f731fb6cf5db"} Jul 09 04:32:45.660018 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.659662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" event={"ID":"8e50bb80-b6ba-408d-9101-6ae231296d9b","Type":"ContainerStarted","Data":"3286f6cde75cc7442e460e4c291b6cf2a21639e54792dda9c2bc072a4c48453a"} Jul 09 04:32:45.670670 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.670621 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-llhnw" podStartSLOduration=30.140190538 podStartE2EDuration="39.670604225s" totalImagesPullingTime="9.530413687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:45.669027426 +0000 UTC m=+46.818072992" watchObservedRunningTime="2026-07-09 04:32:45.670604225 +0000 UTC m=+46.819649795" Jul 09 04:32:45.686055 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.686001 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rj6pn" podStartSLOduration=2.157685902 podStartE2EDuration="11.685982205s" totalImagesPullingTime="9.528296303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:45.684820717 +0000 UTC m=+46.833866287" watchObservedRunningTime="2026-07-09 04:32:45.685982205 +0000 UTC m=+46.835027816" Jul 09 04:32:45.701509 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.700987 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" podStartSLOduration=30.185108943 podStartE2EDuration="39.700968473s" totalImagesPullingTime="9.51585953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:45.699608228 +0000 UTC m=+46.848653812" watchObservedRunningTime="2026-07-09 04:32:45.700968473 +0000 UTC m=+46.850014022" Jul 09 04:32:45.742929 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.738756 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmksb" podStartSLOduration=30.217689536 podStartE2EDuration="39.738738462s" totalImagesPullingTime="9.521048926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:45.715171424 +0000 UTC m=+46.864216996" watchObservedRunningTime="2026-07-09 04:32:45.738738462 +0000 UTC m=+46.887784030" Jul 09 04:32:45.752764 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.752463 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" podStartSLOduration=30.251741729 podStartE2EDuration="39.752443517s" totalImagesPullingTime="9.500701788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:45.752182658 +0000 UTC m=+46.901228250" watchObservedRunningTime="2026-07-09 04:32:45.752443517 +0000 UTC m=+46.901489086" Jul 09 04:32:45.771318 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:45.769868 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" podStartSLOduration=30.259722238 podStartE2EDuration="39.769845774s" totalImagesPullingTime="9.510123536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:45.766847094 +0000 UTC m=+46.915892660" watchObservedRunningTime="2026-07-09 04:32:45.769845774 +0000 UTC m=+46.918891344" Jul 09 04:32:46.553126 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.553086 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qcdvv"] Jul 09 04:32:46.570099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.570066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.574145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.574127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c4pmv\"" Jul 09 04:32:46.574917 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.574895 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 04:32:46.575029 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.574930 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 04:32:46.583156 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.583136 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcdvv"] Jul 09 04:32:46.654417 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.654382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7plxr\" (UniqueName: \"kubernetes.io/projected/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-api-access-7plxr\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.654931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.654486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.654931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.654543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472b5f7-5038-4ce6-a230-82390cde9cea-data-volume\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.654931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.654654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0472b5f7-5038-4ce6-a230-82390cde9cea-crio-socket\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.654931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.654722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.665545 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.665519 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:32:46.665956 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.665941 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/0.log" Jul 09 04:32:46.666012 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.665974 2561 generic.go:356] "Generic (PLEG): container finished" podID="36eea080-9d43-4068-a0d7-56d3c561d0d9" containerID="9e664262ac64a4c9129ee195537879b14797950190d12680a33dea3a610b7d98" exitCode=255 Jul 09 04:32:46.666078 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.666053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" event={"ID":"36eea080-9d43-4068-a0d7-56d3c561d0d9","Type":"ContainerDied","Data":"9e664262ac64a4c9129ee195537879b14797950190d12680a33dea3a610b7d98"} Jul 09 04:32:46.666137 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.666124 2561 scope.go:117] "RemoveContainer" containerID="ffed082cf467514a6feec9fd2a9e42209ac2c7acd2d35c7d3deee26ae1fe4224" Jul 09 04:32:46.666440 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.666425 2561 scope.go:117] "RemoveContainer" containerID="9e664262ac64a4c9129ee195537879b14797950190d12680a33dea3a610b7d98" Jul 09 04:32:46.666642 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:46.666620 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7ct9c_openshift-console-operator(36eea080-9d43-4068-a0d7-56d3c561d0d9)\"" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" podUID="36eea080-9d43-4068-a0d7-56d3c561d0d9" Jul 09 04:32:46.669319 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.669280 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0abb539-f936-432b-a76a-67e0568edf57" containerID="93958b7bf5703c5e5df026fa893144d14cf910ffa4cbbc750bb85575c63498c3" exitCode=0 Jul 09 04:32:46.669403 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.669313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerDied","Data":"93958b7bf5703c5e5df026fa893144d14cf910ffa4cbbc750bb85575c63498c3"} Jul 09 04:32:46.755685 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.755659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472b5f7-5038-4ce6-a230-82390cde9cea-data-volume\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.755934 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.755912 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472b5f7-5038-4ce6-a230-82390cde9cea-data-volume\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.756044 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.755938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0472b5f7-5038-4ce6-a230-82390cde9cea-crio-socket\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.756142 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.756121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.756207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.756144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0472b5f7-5038-4ce6-a230-82390cde9cea-crio-socket\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.756207 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:46.756172 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:32:46.756397 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:46.756229 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:47.256210909 +0000 UTC m=+48.405256478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : configmap "kube-rbac-proxy" not found Jul 09 04:32:46.756604 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.756468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7plxr\" (UniqueName: \"kubernetes.io/projected/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-api-access-7plxr\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.756934 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.756918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:46.757052 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:46.757035 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:32:46.757112 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:46.757085 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:47.257072122 +0000 UTC m=+48.406117668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : secret "insights-runtime-extractor-tls" not found Jul 09 04:32:46.772344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:46.772324 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7plxr\" (UniqueName: \"kubernetes.io/projected/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-api-access-7plxr\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:47.261233 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:47.261201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:47.261393 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:47.261311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:47.261393 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:47.261365 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:32:47.261479 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:47.261430 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:32:47.261479 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:47.261434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:48.261418456 +0000 UTC m=+49.410464002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : secret "insights-runtime-extractor-tls" not found Jul 09 04:32:47.261562 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:47.261495 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:48.261477095 +0000 UTC m=+49.410522654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : configmap "kube-rbac-proxy" not found Jul 09 04:32:47.677961 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:47.677934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:32:47.678479 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:47.678264 2561 scope.go:117] "RemoveContainer" containerID="9e664262ac64a4c9129ee195537879b14797950190d12680a33dea3a610b7d98" Jul 09 04:32:47.678529 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:47.678505 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7ct9c_openshift-console-operator(36eea080-9d43-4068-a0d7-56d3c561d0d9)\"" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" podUID="36eea080-9d43-4068-a0d7-56d3c561d0d9" Jul 09 04:32:47.681132 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:47.681109 2561 generic.go:356] "Generic (PLEG): container finished" podID="b0abb539-f936-432b-a76a-67e0568edf57" containerID="bdbd5e96569d7534686b9fe4f28e9a2b97c4edac49218008042cd3050dcd8f1c" exitCode=0 Jul 09 04:32:47.681245 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:47.681167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerDied","Data":"bdbd5e96569d7534686b9fe4f28e9a2b97c4edac49218008042cd3050dcd8f1c"} Jul 09 04:32:48.270232 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:48.270205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:48.270457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:48.270296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:48.270457 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:48.270357 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:32:48.270457 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:48.270391 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:32:48.270457 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:48.270413 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.270400716 +0000 UTC m=+51.419446264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : configmap "kube-rbac-proxy" not found Jul 09 04:32:48.270457 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:48.270456 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:50.270436993 +0000 UTC m=+51.419482541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : secret "insights-runtime-extractor-tls" not found Jul 09 04:32:48.338222 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:48.338197 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8rg6r_6d889193-5d5b-429f-a351-ffb6fd8001fa/dns-node-resolver/0.log" Jul 09 04:32:48.688166 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:48.688136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" event={"ID":"b0abb539-f936-432b-a76a-67e0568edf57","Type":"ContainerStarted","Data":"d28f7be4531181f37f0b1d525224d721dd3af1c31dceebe8b0985de335c2d402"} Jul 09 04:32:48.710878 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:48.710824 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d9mmb" podStartSLOduration=15.045397872 podStartE2EDuration="49.710809278s" totalImagesPullingTime="34.665411406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:48.709745564 +0000 UTC m=+49.858791133" watchObservedRunningTime="2026-07-09 04:32:48.710809278 +0000 UTC m=+49.859854846" Jul 09 04:32:49.538694 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:49.538665 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mckk4_08115717-84e7-414c-83ed-812ce8a9e66f/node-ca/0.log" Jul 09 04:32:50.285173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.285142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:50.285537 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.285252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:50.285537 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.285277 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:32:50.285537 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.285362 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:54.285344064 +0000 UTC m=+55.434389627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : configmap "kube-rbac-proxy" not found Jul 09 04:32:50.285537 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.285378 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:32:50.285537 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.285414 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:32:54.285402951 +0000 UTC m=+55.434448500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : secret "insights-runtime-extractor-tls" not found Jul 09 04:32:50.337764 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.337736 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rj6pn_e3538224-1512-43c3-9a33-5362ddd714e3/serve-healthcheck-canary/0.log" Jul 09 04:32:50.588581 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.588496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:32:50.588746 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.588616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:32:50.588746 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.588641 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:32:50.588746 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.588658 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c7b4db4ff-xf6rv: secret "image-registry-tls" not found Jul 09 04:32:50.588746 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.588719 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls podName:a18de6dc-65e5-48fb-b423-888b7fe8bacf nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.588700702 +0000 UTC m=+67.737746261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls") pod "image-registry-c7b4db4ff-xf6rv" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf") : secret "image-registry-tls" not found Jul 09 04:32:50.588746 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.588740 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 04:32:50.588924 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.588784 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls podName:75026161-92e3-421c-9087-a6f2ca6a9075 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.58877281 +0000 UTC m=+67.737818356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2dt8w" (UID: "75026161-92e3-421c-9087-a6f2ca6a9075") : secret "samples-operator-tls" not found Jul 09 04:32:50.689520 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.689491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:32:50.689694 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.689675 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:50.689748 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.689737 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls podName:04ef2507-0028-4bf0-b01d-c19acd7e7e81 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.689723803 +0000 UTC m=+67.838769349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-rj7p6" (UID: "04ef2507-0028-4bf0-b01d-c19acd7e7e81") : secret "cluster-monitoring-operator-tls" not found Jul 09 04:32:50.790158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.790131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:32:50.790278 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.790164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:32:50.790350 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.790276 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 04:32:50.790350 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.790348 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert podName:101e9068-82b9-47e9-95f3-b56cb5a33923 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.790336425 +0000 UTC m=+67.939381976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-8tlzr" (UID: "101e9068-82b9-47e9-95f3-b56cb5a33923") : secret "networking-console-plugin-cert" not found Jul 09 04:32:50.790421 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.790346 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:32:50.790421 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.790373 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls podName:11c5ceb4-0ceb-4004-9f3b-8538736c68fd nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.790366689 +0000 UTC m=+67.939412236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls") pod "dns-default-qnsxd" (UID: "11c5ceb4-0ceb-4004-9f3b-8538736c68fd") : secret "dns-default-metrics-tls" not found Jul 09 04:32:50.891017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.890993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:50.891119 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:50.891056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:32:50.891165 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.891118 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 04:32:50.891165 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.891141 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.891127272 +0000 UTC m=+68.040172818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : configmap references non-existent config key: service-ca.crt Jul 09 04:32:50.891165 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:50.891164 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs podName:7fe0d56a-70d3-4d82-b608-7205a506c151 nodeName:}" failed. No retries permitted until 2026-07-09 04:33:06.891154093 +0000 UTC m=+68.040199639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs") pod "router-default-58fffb79c5-wh6w7" (UID: "7fe0d56a-70d3-4d82-b608-7205a506c151") : secret "router-metrics-certs-default" not found Jul 09 04:32:54.321001 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:54.320973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:54.321523 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:54.321061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:32:54.321523 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:54.321111 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:32:54.321523 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:54.321164 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:32:54.321523 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:54.321169 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:33:02.321155918 +0000 UTC m=+63.470201464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : configmap "kube-rbac-proxy" not found Jul 09 04:32:54.321523 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:54.321201 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:33:02.321190939 +0000 UTC m=+63.470236512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : secret "insights-runtime-extractor-tls" not found Jul 09 04:32:55.149009 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:55.148977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:55.149173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:55.149067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:32:55.149405 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:32:55.149393 2561 scope.go:117] "RemoveContainer" containerID="9e664262ac64a4c9129ee195537879b14797950190d12680a33dea3a610b7d98" Jul 09 04:32:55.149549 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:32:55.149530 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-7ct9c_openshift-console-operator(36eea080-9d43-4068-a0d7-56d3c561d0d9)\"" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" podUID="36eea080-9d43-4068-a0d7-56d3c561d0d9" Jul 09 04:33:01.590371 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:01.590345 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9pzp" Jul 09 04:33:02.390906 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:02.390873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:33:02.391062 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:33:02.391010 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:33:02.391062 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:02.391032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:33:02.391062 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:33:02.391063 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls podName:0472b5f7-5038-4ce6-a230-82390cde9cea nodeName:}" failed. No retries permitted until 2026-07-09 04:33:18.391049445 +0000 UTC m=+79.540094992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcdvv" (UID: "0472b5f7-5038-4ce6-a230-82390cde9cea") : secret "insights-runtime-extractor-tls" not found Jul 09 04:33:02.391514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:02.391499 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0472b5f7-5038-4ce6-a230-82390cde9cea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:33:05.113273 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.113243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:33:05.115864 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.115846 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 04:33:05.125983 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.125962 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17f4d907-f511-40e2-ab69-e98dce57a67d-metrics-certs\") pod \"network-metrics-daemon-gtqwj\" (UID: \"17f4d907-f511-40e2-ab69-e98dce57a67d\") " pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:33:05.213637 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.213616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:33:05.216105 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.216090 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 04:33:05.226739 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.226722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85d0abb1-ac9c-45ca-a4bf-548bc3b3a052-original-pull-secret\") pod \"global-pull-secret-syncer-lm7kb\" (UID: \"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052\") " pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:33:05.256218 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.256196 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bx88j\"" Jul 09 04:33:05.261102 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.261088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lm7kb" Jul 09 04:33:05.264225 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.264209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtqwj" Jul 09 04:33:05.315136 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.315107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:33:05.320241 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.320184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2stw\" (UniqueName: \"kubernetes.io/projected/b2182d39-dbbf-476f-a4d2-664e7bcc8539-kube-api-access-z2stw\") pod \"network-check-target-w4mbf\" (UID: \"b2182d39-dbbf-476f-a4d2-664e7bcc8539\") " pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:33:05.397162 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.397066 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lm7kb"] Jul 09 04:33:05.399708 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:05.399685 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d0abb1_ac9c_45ca_a4bf_548bc3b3a052.slice/crio-1914a2ab3a4b9578ff85ac99affadd6d39103e102406c8583c1129100f2d6ec9 WatchSource:0}: Error finding container 1914a2ab3a4b9578ff85ac99affadd6d39103e102406c8583c1129100f2d6ec9: Status 404 returned error can't find the container with id 1914a2ab3a4b9578ff85ac99affadd6d39103e102406c8583c1129100f2d6ec9 Jul 09 04:33:05.409561 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.409538 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtqwj"] Jul 09 04:33:05.412174 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:05.412149 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f4d907_f511_40e2_ab69_e98dce57a67d.slice/crio-0f93df4efdc98e7546a2e8d1ae78766a5bc4711a1466a4da9e2ff9ce42705769 WatchSource:0}: Error finding container 0f93df4efdc98e7546a2e8d1ae78766a5bc4711a1466a4da9e2ff9ce42705769: Status 404 returned error can't find the container with id 0f93df4efdc98e7546a2e8d1ae78766a5bc4711a1466a4da9e2ff9ce42705769 Jul 09 04:33:05.464248 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.464229 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mcbs\"" Jul 09 04:33:05.472228 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.472210 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:33:05.591145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.591023 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w4mbf"] Jul 09 04:33:05.593442 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:05.593417 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2182d39_dbbf_476f_a4d2_664e7bcc8539.slice/crio-73071160caa4aaf4bb0339e699445782ca77763295522591f5a7f6338826aa6e WatchSource:0}: Error finding container 73071160caa4aaf4bb0339e699445782ca77763295522591f5a7f6338826aa6e: Status 404 returned error can't find the container with id 73071160caa4aaf4bb0339e699445782ca77763295522591f5a7f6338826aa6e Jul 09 04:33:05.739179 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.739120 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w4mbf" event={"ID":"b2182d39-dbbf-476f-a4d2-664e7bcc8539","Type":"ContainerStarted","Data":"9871fba5333670ba5783a28a850cc8d8dabf7e28851b91760b5df1add6d44dd0"} Jul 09 04:33:05.739179 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.739166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w4mbf" event={"ID":"b2182d39-dbbf-476f-a4d2-664e7bcc8539","Type":"ContainerStarted","Data":"73071160caa4aaf4bb0339e699445782ca77763295522591f5a7f6338826aa6e"} Jul 09 04:33:05.739357 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.739232 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:33:05.740345 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.740322 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lm7kb" event={"ID":"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052","Type":"ContainerStarted","Data":"1914a2ab3a4b9578ff85ac99affadd6d39103e102406c8583c1129100f2d6ec9"} Jul 09 04:33:05.741222 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.741206 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtqwj" event={"ID":"17f4d907-f511-40e2-ab69-e98dce57a67d","Type":"ContainerStarted","Data":"0f93df4efdc98e7546a2e8d1ae78766a5bc4711a1466a4da9e2ff9ce42705769"} Jul 09 04:33:05.753517 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:05.753466 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w4mbf" podStartSLOduration=66.753451582 podStartE2EDuration="1m6.753451582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:05.753380532 +0000 UTC m=+66.902426104" watchObservedRunningTime="2026-07-09 04:33:05.753451582 +0000 UTC m=+66.902497154" Jul 09 04:33:06.626170 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.626145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:33:06.626541 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.626227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:33:06.628960 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.628906 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"image-registry-c7b4db4ff-xf6rv\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:33:06.629088 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.629054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/75026161-92e3-421c-9087-a6f2ca6a9075-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2dt8w\" (UID: \"75026161-92e3-421c-9087-a6f2ca6a9075\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:33:06.727741 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.727709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:33:06.730645 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.730623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/04ef2507-0028-4bf0-b01d-c19acd7e7e81-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-rj7p6\" (UID: \"04ef2507-0028-4bf0-b01d-c19acd7e7e81\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:33:06.746200 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.746177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtqwj" event={"ID":"17f4d907-f511-40e2-ab69-e98dce57a67d","Type":"ContainerStarted","Data":"868a0b79217b7529d7f16ef7dc488a3375d95506207727f5e46b11a1060592eb"} Jul 09 04:33:06.822467 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.822443 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8hcw8\"" Jul 09 04:33:06.828631 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.828603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:33:06.828765 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.828645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:33:06.830117 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.830095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:33:06.831111 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.831084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11c5ceb4-0ceb-4004-9f3b-8538736c68fd-metrics-tls\") pod \"dns-default-qnsxd\" (UID: \"11c5ceb4-0ceb-4004-9f3b-8538736c68fd\") " pod="openshift-dns/dns-default-qnsxd" Jul 09 04:33:06.831213 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.831133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/101e9068-82b9-47e9-95f3-b56cb5a33923-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-8tlzr\" (UID: \"101e9068-82b9-47e9-95f3-b56cb5a33923\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:33:06.835987 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.835965 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4zhnf\"" Jul 09 04:33:06.844912 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.844891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" Jul 09 04:33:06.929943 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.929588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:06.929943 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.929677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:06.929943 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.929724 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jzfkq\"" Jul 09 04:33:06.930595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.930550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7fe0d56a-70d3-4d82-b608-7205a506c151-service-ca-bundle\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:06.933320 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.932593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fe0d56a-70d3-4d82-b608-7205a506c151-metrics-certs\") pod \"router-default-58fffb79c5-wh6w7\" (UID: \"7fe0d56a-70d3-4d82-b608-7205a506c151\") " pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:06.937343 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.937321 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" Jul 09 04:33:06.971152 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.970941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-58ffk\"" Jul 09 04:33:06.977515 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.977449 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c7b4db4ff-xf6rv"] Jul 09 04:33:06.978910 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.978879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qnsxd" Jul 09 04:33:06.981829 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:06.981806 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18de6dc_65e5_48fb_b423_888b7fe8bacf.slice/crio-66239381f563644c6e766f48f3e1015fc042768e8420f7d43f6005f0e4c45898 WatchSource:0}: Error finding container 66239381f563644c6e766f48f3e1015fc042768e8420f7d43f6005f0e4c45898: Status 404 returned error can't find the container with id 66239381f563644c6e766f48f3e1015fc042768e8420f7d43f6005f0e4c45898 Jul 09 04:33:06.998404 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:06.998331 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w"] Jul 09 04:33:07.054305 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.054056 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dnlc2\"" Jul 09 04:33:07.062368 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.062131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" Jul 09 04:33:07.071781 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.071618 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xnhsp\"" Jul 09 04:33:07.080754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.080585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:07.101103 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.098447 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6"] Jul 09 04:33:07.103485 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:07.103450 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ef2507_0028_4bf0_b01d_c19acd7e7e81.slice/crio-e83682e9bce2d0364b801e29f37d3cab17e4b40914fe47d299f58132ce525764 WatchSource:0}: Error finding container e83682e9bce2d0364b801e29f37d3cab17e4b40914fe47d299f58132ce525764: Status 404 returned error can't find the container with id e83682e9bce2d0364b801e29f37d3cab17e4b40914fe47d299f58132ce525764 Jul 09 04:33:07.144656 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.144557 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qnsxd"] Jul 09 04:33:07.155029 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:07.154989 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c5ceb4_0ceb_4004_9f3b_8538736c68fd.slice/crio-5dbcb1d4d43d9a15f2786df2d419db70117923bc9562dd9c2e1bf44cb17b53d9 WatchSource:0}: Error finding container 5dbcb1d4d43d9a15f2786df2d419db70117923bc9562dd9c2e1bf44cb17b53d9: Status 404 returned error can't find the container with id 5dbcb1d4d43d9a15f2786df2d419db70117923bc9562dd9c2e1bf44cb17b53d9 Jul 09 04:33:07.272021 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.271991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr"] Jul 09 04:33:07.275931 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:07.275900 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101e9068_82b9_47e9_95f3_b56cb5a33923.slice/crio-23c4b0fb019d7d24d860b40532e88b1d882b61023b90038ce5c0d384afb14ef5 WatchSource:0}: Error finding container 23c4b0fb019d7d24d860b40532e88b1d882b61023b90038ce5c0d384afb14ef5: Status 404 returned error can't find the container with id 23c4b0fb019d7d24d860b40532e88b1d882b61023b90038ce5c0d384afb14ef5 Jul 09 04:33:07.295837 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.295767 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58fffb79c5-wh6w7"] Jul 09 04:33:07.300661 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:07.300622 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe0d56a_70d3_4d82_b608_7205a506c151.slice/crio-24cd3bbcf686120e6e734473fc34f97369240183e1a95fbed90d0b8ecfaacb9d WatchSource:0}: Error finding container 24cd3bbcf686120e6e734473fc34f97369240183e1a95fbed90d0b8ecfaacb9d: Status 404 returned error can't find the container with id 24cd3bbcf686120e6e734473fc34f97369240183e1a95fbed90d0b8ecfaacb9d Jul 09 04:33:07.761223 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.761174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" event={"ID":"7fe0d56a-70d3-4d82-b608-7205a506c151","Type":"ContainerStarted","Data":"dd3e8ce5f7c3b45aea894f9ab346c8bf178be716af139fbc17b3d0d24362045e"} Jul 09 04:33:07.761697 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.761277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" event={"ID":"7fe0d56a-70d3-4d82-b608-7205a506c151","Type":"ContainerStarted","Data":"24cd3bbcf686120e6e734473fc34f97369240183e1a95fbed90d0b8ecfaacb9d"} Jul 09 04:33:07.762957 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.762931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnsxd" event={"ID":"11c5ceb4-0ceb-4004-9f3b-8538736c68fd","Type":"ContainerStarted","Data":"5dbcb1d4d43d9a15f2786df2d419db70117923bc9562dd9c2e1bf44cb17b53d9"} Jul 09 04:33:07.766613 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.766579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" event={"ID":"75026161-92e3-421c-9087-a6f2ca6a9075","Type":"ContainerStarted","Data":"ea886a8f3913f517a56ebae70420ba867f664ed9bccef88ee765f0f4e1021d37"} Jul 09 04:33:07.768905 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.768880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtqwj" event={"ID":"17f4d907-f511-40e2-ab69-e98dce57a67d","Type":"ContainerStarted","Data":"e182cda6274304fdf0a532e271ac08d0af8aacde41c04779ec28333c7b57b045"} Jul 09 04:33:07.770713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.770686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" event={"ID":"101e9068-82b9-47e9-95f3-b56cb5a33923","Type":"ContainerStarted","Data":"23c4b0fb019d7d24d860b40532e88b1d882b61023b90038ce5c0d384afb14ef5"} Jul 09 04:33:07.772738 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.772691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" event={"ID":"04ef2507-0028-4bf0-b01d-c19acd7e7e81","Type":"ContainerStarted","Data":"e83682e9bce2d0364b801e29f37d3cab17e4b40914fe47d299f58132ce525764"} Jul 09 04:33:07.774799 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.774772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" event={"ID":"a18de6dc-65e5-48fb-b423-888b7fe8bacf","Type":"ContainerStarted","Data":"1952ffb975d1fd399aa48b61dfa350212b2e80ed43c477cc7f4676bf02bd832e"} Jul 09 04:33:07.774903 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.774815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" event={"ID":"a18de6dc-65e5-48fb-b423-888b7fe8bacf","Type":"ContainerStarted","Data":"66239381f563644c6e766f48f3e1015fc042768e8420f7d43f6005f0e4c45898"} Jul 09 04:33:07.774903 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.774854 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:33:07.793453 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.792909 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" podStartSLOduration=61.792889969 podStartE2EDuration="1m1.792889969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:07.778803993 +0000 UTC m=+68.927849564" watchObservedRunningTime="2026-07-09 04:33:07.792889969 +0000 UTC m=+68.941935537" Jul 09 04:33:07.794458 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.794086 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gtqwj" podStartSLOduration=67.59833167 podStartE2EDuration="1m8.794071365s" totalImagesPullingTime="1.195739695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:07.793694124 +0000 UTC m=+68.942739694" watchObservedRunningTime="2026-07-09 04:33:07.794071365 +0000 UTC m=+68.943116935" Jul 09 04:33:07.811156 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:07.811088 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" podStartSLOduration=67.811071875 podStartE2EDuration="1m7.811071875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:07.810211874 +0000 UTC m=+68.959257444" watchObservedRunningTime="2026-07-09 04:33:07.811071875 +0000 UTC m=+68.960117446" Jul 09 04:33:08.081422 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:08.081337 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:08.084142 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:08.084113 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:08.781247 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:08.781094 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:08.783317 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:08.783110 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58fffb79c5-wh6w7" Jul 09 04:33:09.438684 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:09.438657 2561 scope.go:117] "RemoveContainer" containerID="9e664262ac64a4c9129ee195537879b14797950190d12680a33dea3a610b7d98" Jul 09 04:33:12.801306 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.801188 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" event={"ID":"101e9068-82b9-47e9-95f3-b56cb5a33923","Type":"ContainerStarted","Data":"6008b1afce0d0e95ff73910f385ef3069a229b3da590411f73d25ff2f16e294f"} Jul 09 04:33:12.803041 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.803013 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" event={"ID":"04ef2507-0028-4bf0-b01d-c19acd7e7e81","Type":"ContainerStarted","Data":"29823001160ed499f4b5aaf5fdbf4a7231af03546548fc34dd00e6887709b870"} Jul 09 04:33:12.804433 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.804408 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lm7kb" event={"ID":"85d0abb1-ac9c-45ca-a4bf-548bc3b3a052","Type":"ContainerStarted","Data":"11a8d37360f2fc55946212ddbc04be3f0d0981ff363f94f714281d4cde10d4b8"} Jul 09 04:33:12.806173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.806152 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnsxd" event={"ID":"11c5ceb4-0ceb-4004-9f3b-8538736c68fd","Type":"ContainerStarted","Data":"2e9be2b8ffda701cb89edf8bf17ac6f2eef5dee6916e0eda987b8b4606718454"} Jul 09 04:33:12.806312 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.806187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qnsxd" event={"ID":"11c5ceb4-0ceb-4004-9f3b-8538736c68fd","Type":"ContainerStarted","Data":"c53ec52ea8ba3269730a37874087d134b6eb6616d46155e93a25f0f388b9fcca"} Jul 09 04:33:12.806312 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.806241 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qnsxd" Jul 09 04:33:12.807868 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.807849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" event={"ID":"75026161-92e3-421c-9087-a6f2ca6a9075","Type":"ContainerStarted","Data":"68e4ca2471c7768edf3def5b09c66656d6d0c1b695443818bc766e0204f28fc3"} Jul 09 04:33:12.807973 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.807885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" event={"ID":"75026161-92e3-421c-9087-a6f2ca6a9075","Type":"ContainerStarted","Data":"ab130de4cbee1e7bfc4e7497b67061833e2a2b0265d4c76f5fe9a373f6e54904"} Jul 09 04:33:12.809911 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.809892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:33:12.810049 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.809954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" event={"ID":"36eea080-9d43-4068-a0d7-56d3c561d0d9","Type":"ContainerStarted","Data":"b51f80aa04cb752b3d75ca3e034e5f17fc18a763f647440c3dbc2d07663b26ca"} Jul 09 04:33:12.810340 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.810309 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:33:12.829990 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.829942 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-8tlzr" podStartSLOduration=45.82106202 podStartE2EDuration="50.82992685s" totalImagesPullingTime="5.00886483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:12.828280985 +0000 UTC m=+73.977326554" watchObservedRunningTime="2026-07-09 04:33:12.82992685 +0000 UTC m=+73.978972418" Jul 09 04:33:12.847989 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.847928 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" podStartSLOduration=57.327226067 podStartE2EDuration="1m6.847908434s" totalImagesPullingTime="9.520682367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:12.847756218 +0000 UTC m=+73.996801810" watchObservedRunningTime="2026-07-09 04:33:12.847908434 +0000 UTC m=+73.996954005" Jul 09 04:33:12.863545 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.863494 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lm7kb" podStartSLOduration=66.966937066 podStartE2EDuration="1m13.863475726s" totalImagesPullingTime="6.89653866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:12.862164727 +0000 UTC m=+74.011210297" watchObservedRunningTime="2026-07-09 04:33:12.863475726 +0000 UTC m=+74.012521296" Jul 09 04:33:12.878886 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.878834 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-rj7p6" podStartSLOduration=61.696265821 podStartE2EDuration="1m6.878816876s" totalImagesPullingTime="5.182551055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:12.877356167 +0000 UTC m=+74.026401738" watchObservedRunningTime="2026-07-09 04:33:12.878816876 +0000 UTC m=+74.027862444" Jul 09 04:33:12.898964 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.898909 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qnsxd" podStartSLOduration=33.773738864 podStartE2EDuration="38.89889179s" totalImagesPullingTime="5.125152926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:12.897555088 +0000 UTC m=+74.046600658" watchObservedRunningTime="2026-07-09 04:33:12.89889179 +0000 UTC m=+74.047937361" Jul 09 04:33:12.922636 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:12.922593 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2dt8w" podStartSLOduration=61.680750615 podStartE2EDuration="1m6.92257767s" totalImagesPullingTime="5.241827055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:12.922037567 +0000 UTC m=+74.071083140" watchObservedRunningTime="2026-07-09 04:33:12.92257767 +0000 UTC m=+74.071623239" Jul 09 04:33:13.011176 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:13.011147 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-7ct9c" Jul 09 04:33:18.431432 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:18.431395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:33:18.433653 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:18.433623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0472b5f7-5038-4ce6-a230-82390cde9cea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcdvv\" (UID: \"0472b5f7-5038-4ce6-a230-82390cde9cea\") " pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:33:18.682312 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:18.682222 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c4pmv\"" Jul 09 04:33:18.690247 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:18.690223 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcdvv" Jul 09 04:33:18.838320 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:18.838277 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcdvv"] Jul 09 04:33:18.840697 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:18.840673 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0472b5f7_5038_4ce6_a230_82390cde9cea.slice/crio-07f25db7f26a9567d8fc903917b2d5418887a4ca59556e59d5f2c10e63437653 WatchSource:0}: Error finding container 07f25db7f26a9567d8fc903917b2d5418887a4ca59556e59d5f2c10e63437653: Status 404 returned error can't find the container with id 07f25db7f26a9567d8fc903917b2d5418887a4ca59556e59d5f2c10e63437653 Jul 09 04:33:19.835378 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:19.835299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcdvv" event={"ID":"0472b5f7-5038-4ce6-a230-82390cde9cea","Type":"ContainerStarted","Data":"07f25db7f26a9567d8fc903917b2d5418887a4ca59556e59d5f2c10e63437653"} Jul 09 04:33:22.815136 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.815112 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qnsxd" Jul 09 04:33:22.848718 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.848695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcdvv" event={"ID":"0472b5f7-5038-4ce6-a230-82390cde9cea","Type":"ContainerStarted","Data":"bd08fccae4ffb7a93dd219fea5601495d824c41dc70f369c4c36558c03fa5ea4"} Jul 09 04:33:22.911803 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.911778 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585cf9b7db-p2f8t"] Jul 09 04:33:22.914798 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.914782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:22.917887 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.917865 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 04:33:22.918355 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.918339 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 04:33:22.918445 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.918376 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 04:33:22.918502 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.918456 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 04:33:22.918556 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.918502 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 04:33:22.918607 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.918592 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k7dhp\"" Jul 09 04:33:22.919173 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.919111 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 04:33:22.924116 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.924098 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 04:33:22.934570 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:22.934553 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585cf9b7db-p2f8t"] Jul 09 04:33:23.070672 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.070582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxh88\" (UniqueName: \"kubernetes.io/projected/79513c46-46d8-401b-a8da-3331cb37d68f-kube-api-access-jxh88\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.070672 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.070632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-service-ca\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.070856 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.070683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-serving-cert\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.070856 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.070722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-console-config\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.070856 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.070794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-oauth-serving-cert\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.070856 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.070826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-oauth-config\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.171310 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.171262 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxh88\" (UniqueName: \"kubernetes.io/projected/79513c46-46d8-401b-a8da-3331cb37d68f-kube-api-access-jxh88\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.171491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.171338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-service-ca\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.171491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.171368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-serving-cert\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.171491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.171403 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-console-config\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.171491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.171448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-oauth-serving-cert\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.171491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.171473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-oauth-config\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.172105 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.172079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-oauth-serving-cert\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.172228 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.172126 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-service-ca\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.172228 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.172160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-console-config\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.173787 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.173759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-serving-cert\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.173787 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.173772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-oauth-config\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.178058 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.178040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxh88\" (UniqueName: \"kubernetes.io/projected/79513c46-46d8-401b-a8da-3331cb37d68f-kube-api-access-jxh88\") pod \"console-585cf9b7db-p2f8t\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.226065 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.226038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:23.360060 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.360035 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585cf9b7db-p2f8t"] Jul 09 04:33:23.362371 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:23.362343 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79513c46_46d8_401b_a8da_3331cb37d68f.slice/crio-8b6a2a8d151bce0cf9da95560669e450c54533acab8b25becbb47b3f6cfcefc7 WatchSource:0}: Error finding container 8b6a2a8d151bce0cf9da95560669e450c54533acab8b25becbb47b3f6cfcefc7: Status 404 returned error can't find the container with id 8b6a2a8d151bce0cf9da95560669e450c54533acab8b25becbb47b3f6cfcefc7 Jul 09 04:33:23.854156 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.854120 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcdvv" event={"ID":"0472b5f7-5038-4ce6-a230-82390cde9cea","Type":"ContainerStarted","Data":"a7b4f8667ee2c94f5879ca84ae8b2941059286b4b1836e2deda9ed2c3b284edb"} Jul 09 04:33:23.855193 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:23.855168 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cf9b7db-p2f8t" event={"ID":"79513c46-46d8-401b-a8da-3331cb37d68f","Type":"ContainerStarted","Data":"8b6a2a8d151bce0cf9da95560669e450c54533acab8b25becbb47b3f6cfcefc7"} Jul 09 04:33:27.873588 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:27.873549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcdvv" event={"ID":"0472b5f7-5038-4ce6-a230-82390cde9cea","Type":"ContainerStarted","Data":"db53a0306678903bee984b018c13e59213e03457d7cf18712ea3806f2df20104"} Jul 09 04:33:27.875082 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:27.875059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cf9b7db-p2f8t" event={"ID":"79513c46-46d8-401b-a8da-3331cb37d68f","Type":"ContainerStarted","Data":"e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4"} Jul 09 04:33:27.891409 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:27.891363 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qcdvv" podStartSLOduration=33.744879616 podStartE2EDuration="41.891346379s" totalImagesPullingTime="8.146466763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:32:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:27.889767885 +0000 UTC m=+89.038813452" watchObservedRunningTime="2026-07-09 04:33:27.891346379 +0000 UTC m=+89.040391948" Jul 09 04:33:27.908522 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:27.908477 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585cf9b7db-p2f8t" podStartSLOduration=2.169486466 podStartE2EDuration="5.908461364s" totalImagesPullingTime="3.738974898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:27.907362897 +0000 UTC m=+89.056408466" watchObservedRunningTime="2026-07-09 04:33:27.908461364 +0000 UTC m=+89.057506931" Jul 09 04:33:28.385795 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.385765 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4tr75"] Jul 09 04:33:28.389226 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.389210 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.391540 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.391520 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 04:33:28.391540 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.391543 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cxmjg\"" Jul 09 04:33:28.391725 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.391549 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 04:33:28.391725 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.391613 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 04:33:28.391725 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.391659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 04:33:28.512017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.511986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-wtmp\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-accelerators-collector-config\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-root\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba0691a0-e276-4505-a8f9-323188eae54f-metrics-client-ca\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw74j\" (UniqueName: \"kubernetes.io/projected/ba0691a0-e276-4505-a8f9-323188eae54f-kube-api-access-sw74j\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-tls\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-textfile\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.512438 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.512266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-sys\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.612981 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.612951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-wtmp\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.612981 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.612983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-accelerators-collector-config\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-root\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba0691a0-e276-4505-a8f9-323188eae54f-metrics-client-ca\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw74j\" (UniqueName: \"kubernetes.io/projected/ba0691a0-e276-4505-a8f9-323188eae54f-kube-api-access-sw74j\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-tls\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-root\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-textfile\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-sys\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613514 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:33:28.613257 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 04:33:28.613514 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:33:28.613330 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-tls podName:ba0691a0-e276-4505-a8f9-323188eae54f nodeName:}" failed. No retries permitted until 2026-07-09 04:33:29.113312246 +0000 UTC m=+90.262357793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-tls") pod "node-exporter-4tr75" (UID: "ba0691a0-e276-4505-a8f9-323188eae54f") : secret "node-exporter-tls" not found Jul 09 04:33:28.613514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-sys\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613130 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-wtmp\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-textfile\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613817 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613768 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-accelerators-collector-config\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.613958 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.613940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba0691a0-e276-4505-a8f9-323188eae54f-metrics-client-ca\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.615646 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.615618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.622165 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.622145 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw74j\" (UniqueName: \"kubernetes.io/projected/ba0691a0-e276-4505-a8f9-323188eae54f-kube-api-access-sw74j\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:28.786827 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:28.786758 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:33:29.119151 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:29.119123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-tls\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:29.121460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:29.121420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba0691a0-e276-4505-a8f9-323188eae54f-node-exporter-tls\") pod \"node-exporter-4tr75\" (UID: \"ba0691a0-e276-4505-a8f9-323188eae54f\") " pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:29.298218 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:29.298186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4tr75" Jul 09 04:33:29.310802 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:29.310777 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0691a0_e276_4505_a8f9_323188eae54f.slice/crio-9d0c8207e2b02d058a76c1f623f6d1daeee548cce213b1d077f822ced6d77424 WatchSource:0}: Error finding container 9d0c8207e2b02d058a76c1f623f6d1daeee548cce213b1d077f822ced6d77424: Status 404 returned error can't find the container with id 9d0c8207e2b02d058a76c1f623f6d1daeee548cce213b1d077f822ced6d77424 Jul 09 04:33:29.883980 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:29.883943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tr75" event={"ID":"ba0691a0-e276-4505-a8f9-323188eae54f","Type":"ContainerStarted","Data":"9d0c8207e2b02d058a76c1f623f6d1daeee548cce213b1d077f822ced6d77424"} Jul 09 04:33:30.351819 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.351739 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c96fb698-xzzw5"] Jul 09 04:33:30.355767 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.355747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.358200 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358174 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rrqrl\"" Jul 09 04:33:30.358200 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358174 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 04:33:30.358379 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358230 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 04:33:30.358379 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358274 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 04:33:30.358379 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4e412i2t0tuid\"" Jul 09 04:33:30.358379 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358333 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 04:33:30.358923 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.358901 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 04:33:30.366310 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.366278 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c96fb698-xzzw5"] Jul 09 04:33:30.428327 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94346f53-8038-49e9-854b-7dce290b3605-metrics-client-ca\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428327 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-grpc-tls\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428562 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428562 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428562 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428562 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfx7l\" (UniqueName: \"kubernetes.io/projected/94346f53-8038-49e9-854b-7dce290b3605-kube-api-access-sfx7l\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428750 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-tls\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.428750 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.428614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529597 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfx7l\" (UniqueName: \"kubernetes.io/projected/94346f53-8038-49e9-854b-7dce290b3605-kube-api-access-sfx7l\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-tls\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94346f53-8038-49e9-854b-7dce290b3605-metrics-client-ca\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.529774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-grpc-tls\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.530060 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.529857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.530535 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.530487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94346f53-8038-49e9-854b-7dce290b3605-metrics-client-ca\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.532453 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.532426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.532549 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.532534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-grpc-tls\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.532599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.532546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-tls\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.532800 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.532783 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.532954 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.532936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.533006 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.532990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94346f53-8038-49e9-854b-7dce290b3605-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.537371 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.537351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfx7l\" (UniqueName: \"kubernetes.io/projected/94346f53-8038-49e9-854b-7dce290b3605-kube-api-access-sfx7l\") pod \"thanos-querier-6c96fb698-xzzw5\" (UID: \"94346f53-8038-49e9-854b-7dce290b3605\") " pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.667235 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.667203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:30.798667 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.798639 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c96fb698-xzzw5"] Jul 09 04:33:30.801134 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:30.801102 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94346f53_8038_49e9_854b_7dce290b3605.slice/crio-0ecd50e8f687397d643f63111416ae914835001640e45606faaa481e6042e296 WatchSource:0}: Error finding container 0ecd50e8f687397d643f63111416ae914835001640e45606faaa481e6042e296: Status 404 returned error can't find the container with id 0ecd50e8f687397d643f63111416ae914835001640e45606faaa481e6042e296 Jul 09 04:33:30.889145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.889114 2561 generic.go:356] "Generic (PLEG): container finished" podID="ba0691a0-e276-4505-a8f9-323188eae54f" containerID="648a0eda1c767dab3c3b30c2d851785eb1bcc8b9605893eecfc8b20e7f59abeb" exitCode=0 Jul 09 04:33:30.889351 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.889158 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tr75" event={"ID":"ba0691a0-e276-4505-a8f9-323188eae54f","Type":"ContainerDied","Data":"648a0eda1c767dab3c3b30c2d851785eb1bcc8b9605893eecfc8b20e7f59abeb"} Jul 09 04:33:30.890405 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:30.890385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"0ecd50e8f687397d643f63111416ae914835001640e45606faaa481e6042e296"} Jul 09 04:33:31.901420 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:31.901378 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tr75" event={"ID":"ba0691a0-e276-4505-a8f9-323188eae54f","Type":"ContainerStarted","Data":"465ef656fe30f3d1ae0dea18c60513ae3d88d54ce597e524fd3834e2d324adb3"} Jul 09 04:33:31.901854 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:31.901449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4tr75" event={"ID":"ba0691a0-e276-4505-a8f9-323188eae54f","Type":"ContainerStarted","Data":"c27e6cbdba7c4b39af913d2e291513a0c3c599eed99ca828f3781fe85ab72f1e"} Jul 09 04:33:31.920255 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:31.920171 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4tr75" podStartSLOduration=2.628381316 podStartE2EDuration="3.920156734s" totalImagesPullingTime="1.230211196s" totalInitContainerRuntime="61.564222ms" isStatefulPod=true podCreationTimestamp="2026-07-09 04:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:31.918440769 +0000 UTC m=+93.067486336" watchObservedRunningTime="2026-07-09 04:33:31.920156734 +0000 UTC m=+93.069202301" Jul 09 04:33:33.226494 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.226402 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:33.226494 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.226473 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:33.231188 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.231166 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:33.626158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.626120 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c7b4db4ff-xf6rv"] Jul 09 04:33:33.912852 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.912779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"5845c15f56c8f59782362a863a3b33c532ff9fd8ab3f2b8afa58843e5f4993d0"} Jul 09 04:33:33.912987 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.912858 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"3f6a36a70410b4925da051d8bcc50ea719182cca7173c7be99f9d18c1dea7615"} Jul 09 04:33:33.912987 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.912909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"e6c2577d432e4bc8ee09a60030192ddab9d67b3a03653f2f95d807d7a6102f9f"} Jul 09 04:33:33.916763 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:33.916746 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:33:34.602782 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.602748 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:33:34.608544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.608515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.613376 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613354 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 04:33:34.613530 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613510 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 04:33:34.613650 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613633 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 04:33:34.613736 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613633 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6kv9an3j7rl8v\"" Jul 09 04:33:34.613871 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613853 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 04:33:34.613945 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613868 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 04:33:34.613945 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.613891 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 04:33:34.614043 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 04:33:34.614202 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614182 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 04:33:34.614202 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614199 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 04:33:34.614410 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614189 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 04:33:34.614410 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614213 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 04:33:34.614576 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 04:33:34.614665 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614582 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 04:33:34.614665 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 04:33:34.615070 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.614990 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qq9c7\"" Jul 09 04:33:34.618987 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.618971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 04:33:34.623742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.623724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:33:34.666402 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666558 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666558 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j24n\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-kube-api-access-8j24n\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666558 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666710 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666710 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666710 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666710 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666849 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666849 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666849 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666849 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666849 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.666849 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.667026 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.667026 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.667026 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.667026 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.667026 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.667026 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.666950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.767982 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.767945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.767982 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.767987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768242 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768242 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768242 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768402 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768402 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768402 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768402 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768415 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j24n\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-kube-api-access-8j24n\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768599 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768880 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768880 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768880 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768880 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768880 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.768880 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.769151 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.768933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.769151 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.769053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.769434 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.769412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.771242 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.771315 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.771438 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.771442 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.771746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.771831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.772068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772183 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.772127 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772644 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.772201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.772644 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.772538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.773874 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.773849 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.774103 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.774074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.774238 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.774219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.774311 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.774267 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.774363 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.774347 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.778447 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.778425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j24n\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-kube-api-access-8j24n\") pod \"prometheus-k8s-0\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.919094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.919068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:34.919931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.919900 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"205f4607abd7851c86ca68c621b1b4fa887d2fb135bf702f3b7c7fc262f1a935"} Jul 09 04:33:34.920042 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.919975 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"e7868a342d0ed206dfa7d11dc50e06a4e4bab9aa468f0d1a49bd452b6a9fd4d4"} Jul 09 04:33:34.920042 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.920004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" event={"ID":"94346f53-8038-49e9-854b-7dce290b3605","Type":"ContainerStarted","Data":"651d668425894feecc44b89c1161f4e03e3ab6a704ea26740600a92576b15d75"} Jul 09 04:33:34.920158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.920091 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:34.940657 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:34.940603 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" podStartSLOduration=1.953448163 podStartE2EDuration="4.940588566s" totalImagesPullingTime="2.987140403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:34.939383635 +0000 UTC m=+96.088429202" watchObservedRunningTime="2026-07-09 04:33:34.940588566 +0000 UTC m=+96.089634133" Jul 09 04:33:35.055549 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.055527 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:33:35.057272 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:35.057247 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d56fe9c_4e24_4526_bd0a_54dcdad0bd8f.slice/crio-c28957915ec37e3a74f30f41aeab4da3e7412e69f5af49dd5fd5ee0d5c04bbf0 WatchSource:0}: Error finding container c28957915ec37e3a74f30f41aeab4da3e7412e69f5af49dd5fd5ee0d5c04bbf0: Status 404 returned error can't find the container with id c28957915ec37e3a74f30f41aeab4da3e7412e69f5af49dd5fd5ee0d5c04bbf0 Jul 09 04:33:35.925793 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.925761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"c28957915ec37e3a74f30f41aeab4da3e7412e69f5af49dd5fd5ee0d5c04bbf0"} Jul 09 04:33:35.936210 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.936185 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6b65f5c5-r67ws"] Jul 09 04:33:35.939620 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.939603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.947134 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.947103 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 04:33:35.948411 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.948313 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6b65f5c5-r67ws"] Jul 09 04:33:35.978023 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.977994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-serving-cert\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.978325 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.978298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9r4n\" (UniqueName: \"kubernetes.io/projected/0d0aa8e2-d01f-4c46-a631-726773b6afcd-kube-api-access-g9r4n\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.978429 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.978364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-service-ca\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.978429 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.978390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-oauth-serving-cert\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.978559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.978484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-oauth-config\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.978559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.978508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-trusted-ca-bundle\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:35.978664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:35.978602 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-config\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.079820 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.079778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9r4n\" (UniqueName: \"kubernetes.io/projected/0d0aa8e2-d01f-4c46-a631-726773b6afcd-kube-api-access-g9r4n\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.079820 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.079823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-service-ca\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080045 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.079850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-oauth-serving-cert\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080045 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.079895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-oauth-config\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080045 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.079925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-trusted-ca-bundle\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080045 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.079968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-config\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080045 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.080019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-serving-cert\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080574 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.080551 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-service-ca\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080694 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.080670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-oauth-serving-cert\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080730 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.080681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-config\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.080826 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.080811 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-trusted-ca-bundle\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.082344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.082325 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-serving-cert\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.082415 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.082380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-oauth-config\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.086986 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.086969 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9r4n\" (UniqueName: \"kubernetes.io/projected/0d0aa8e2-d01f-4c46-a631-726773b6afcd-kube-api-access-g9r4n\") pod \"console-5f6b65f5c5-r67ws\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.252392 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.252322 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:36.578831 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.578803 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6b65f5c5-r67ws"] Jul 09 04:33:36.581218 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:33:36.581187 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d0aa8e2_d01f_4c46_a631_726773b6afcd.slice/crio-2e35f9697a393e07dd32bb3e684d2fccc6bae0e4f6eec1a7838e84f9da4ee68d WatchSource:0}: Error finding container 2e35f9697a393e07dd32bb3e684d2fccc6bae0e4f6eec1a7838e84f9da4ee68d: Status 404 returned error can't find the container with id 2e35f9697a393e07dd32bb3e684d2fccc6bae0e4f6eec1a7838e84f9da4ee68d Jul 09 04:33:36.748989 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.748959 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w4mbf" Jul 09 04:33:36.931303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.931256 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" exitCode=0 Jul 09 04:33:36.931724 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.931324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} Jul 09 04:33:36.932988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.932966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6b65f5c5-r67ws" event={"ID":"0d0aa8e2-d01f-4c46-a631-726773b6afcd","Type":"ContainerStarted","Data":"3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a"} Jul 09 04:33:36.933034 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.933011 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6b65f5c5-r67ws" event={"ID":"0d0aa8e2-d01f-4c46-a631-726773b6afcd","Type":"ContainerStarted","Data":"2e35f9697a393e07dd32bb3e684d2fccc6bae0e4f6eec1a7838e84f9da4ee68d"} Jul 09 04:33:36.974083 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:36.974038 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6b65f5c5-r67ws" podStartSLOduration=1.974022758 podStartE2EDuration="1.974022758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:36.972973202 +0000 UTC m=+98.122018772" watchObservedRunningTime="2026-07-09 04:33:36.974022758 +0000 UTC m=+98.123068325" Jul 09 04:33:40.932460 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:40.932438 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c96fb698-xzzw5" Jul 09 04:33:40.952833 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:40.952764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} Jul 09 04:33:40.952946 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:40.952851 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} Jul 09 04:33:40.952946 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:40.952891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} Jul 09 04:33:41.959550 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:41.959510 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} Jul 09 04:33:41.960002 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:41.959615 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} Jul 09 04:33:41.960002 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:41.959657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerStarted","Data":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} Jul 09 04:33:41.985308 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:41.985224 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.780319134 podStartE2EDuration="7.985205234s" totalImagesPullingTime="5.181055047s" totalInitContainerRuntime="23.831053ms" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:41.982583602 +0000 UTC m=+103.131629213" watchObservedRunningTime="2026-07-09 04:33:41.985205234 +0000 UTC m=+103.134250802" Jul 09 04:33:44.919897 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:44.919860 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:33:46.253450 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:46.253410 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:46.253900 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:46.253488 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:46.258133 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:46.258109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:46.983872 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:46.983845 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:33:47.029116 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:47.029079 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585cf9b7db-p2f8t"] Jul 09 04:33:52.000119 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:52.000084 2561 generic.go:356] "Generic (PLEG): container finished" podID="e60c6c3f-e7de-4e9e-852c-43b067909a3a" containerID="6ab209e7519ed3de348eae26b6bf4a6103bbaea06f8615d77813f731fb6cf5db" exitCode=0 Jul 09 04:33:52.000492 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:52.000157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" event={"ID":"e60c6c3f-e7de-4e9e-852c-43b067909a3a","Type":"ContainerDied","Data":"6ab209e7519ed3de348eae26b6bf4a6103bbaea06f8615d77813f731fb6cf5db"} Jul 09 04:33:52.000492 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:52.000476 2561 scope.go:117] "RemoveContainer" containerID="6ab209e7519ed3de348eae26b6bf4a6103bbaea06f8615d77813f731fb6cf5db" Jul 09 04:33:53.005406 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:53.005372 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wsd9k" event={"ID":"e60c6c3f-e7de-4e9e-852c-43b067909a3a","Type":"ContainerStarted","Data":"aef894486e43bd5ae7a197a19b7b3828472f990f3351abc2e90c8ed93b3f5148"} Jul 09 04:33:56.019187 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:56.019102 2561 generic.go:356] "Generic (PLEG): container finished" podID="d37e4720-8db5-42fa-a34f-7eba60e6b08d" containerID="694083298a211934e2dd68db19b7a7faf863186bb53319c9bba7b46198d43b34" exitCode=0 Jul 09 04:33:56.019551 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:56.019176 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" event={"ID":"d37e4720-8db5-42fa-a34f-7eba60e6b08d","Type":"ContainerDied","Data":"694083298a211934e2dd68db19b7a7faf863186bb53319c9bba7b46198d43b34"} Jul 09 04:33:56.019592 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:56.019554 2561 scope.go:117] "RemoveContainer" containerID="694083298a211934e2dd68db19b7a7faf863186bb53319c9bba7b46198d43b34" Jul 09 04:33:57.025056 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:57.025025 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-mq946" event={"ID":"d37e4720-8db5-42fa-a34f-7eba60e6b08d","Type":"ContainerStarted","Data":"aa249884f0b90aa9a1a5ba233084e1b751ecc8f7f3b9512f46bd6138a7a98392"} Jul 09 04:33:57.081755 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:57.081730 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fffb79c5-wh6w7_7fe0d56a-70d3-4d82-b608-7205a506c151/router/0.log" Jul 09 04:33:57.093590 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:57.093555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rj6pn_e3538224-1512-43c3-9a33-5362ddd714e3/serve-healthcheck-canary/0.log" Jul 09 04:33:58.645593 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:58.645553 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" podUID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" containerName="registry" containerID="cri-o://1952ffb975d1fd399aa48b61dfa350212b2e80ed43c477cc7f4676bf02bd832e" gracePeriod=30 Jul 09 04:33:58.781874 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:58.781829 2561 patch_prober.go:28] interesting pod/image-registry-c7b4db4ff-xf6rv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" start-of-body= Jul 09 04:33:58.782011 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:58.781889 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" podUID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.6:5000/healthz\": dial tcp 10.132.0.6:5000: connect: connection refused" Jul 09 04:33:59.034732 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.034661 2561 generic.go:356] "Generic (PLEG): container finished" podID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" containerID="1952ffb975d1fd399aa48b61dfa350212b2e80ed43c477cc7f4676bf02bd832e" exitCode=0 Jul 09 04:33:59.034867 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.034733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" event={"ID":"a18de6dc-65e5-48fb-b423-888b7fe8bacf","Type":"ContainerDied","Data":"1952ffb975d1fd399aa48b61dfa350212b2e80ed43c477cc7f4676bf02bd832e"} Jul 09 04:33:59.432083 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.432054 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:33:59.591145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591062 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-installation-pull-secrets\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591145 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591115 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a18de6dc-65e5-48fb-b423-888b7fe8bacf-ca-trust-extracted\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591147 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-image-registry-private-configuration\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591180 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-certificates\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591241 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591265 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jqxf\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-kube-api-access-8jqxf\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591538 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591368 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-trusted-ca\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591538 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591495 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-bound-sa-token\") pod \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\" (UID: \"a18de6dc-65e5-48fb-b423-888b7fe8bacf\") " Jul 09 04:33:59.591625 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591584 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:33:59.591872 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.591840 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-certificates\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.592233 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.592209 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:33:59.593497 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.593469 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:33:59.593784 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.593762 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:59.593888 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.593781 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:33:59.593977 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.593953 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-kube-api-access-8jqxf" (OuterVolumeSpecName: "kube-api-access-8jqxf") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "kube-api-access-8jqxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:59.594118 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.594101 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:59.599220 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.599197 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18de6dc-65e5-48fb-b423-888b7fe8bacf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a18de6dc-65e5-48fb-b423-888b7fe8bacf" (UID: "a18de6dc-65e5-48fb-b423-888b7fe8bacf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:59.692629 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692601 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-installation-pull-secrets\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.692629 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692625 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a18de6dc-65e5-48fb-b423-888b7fe8bacf-ca-trust-extracted\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.692629 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692634 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a18de6dc-65e5-48fb-b423-888b7fe8bacf-image-registry-private-configuration\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.693019 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692644 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-registry-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.693019 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692652 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jqxf\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-kube-api-access-8jqxf\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.693019 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692660 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a18de6dc-65e5-48fb-b423-888b7fe8bacf-trusted-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:33:59.693019 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:33:59.692669 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a18de6dc-65e5-48fb-b423-888b7fe8bacf-bound-sa-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:00.039423 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:00.039396 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" Jul 09 04:34:00.039587 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:00.039395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c7b4db4ff-xf6rv" event={"ID":"a18de6dc-65e5-48fb-b423-888b7fe8bacf","Type":"ContainerDied","Data":"66239381f563644c6e766f48f3e1015fc042768e8420f7d43f6005f0e4c45898"} Jul 09 04:34:00.039587 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:00.039527 2561 scope.go:117] "RemoveContainer" containerID="1952ffb975d1fd399aa48b61dfa350212b2e80ed43c477cc7f4676bf02bd832e" Jul 09 04:34:00.059327 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:00.059277 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c7b4db4ff-xf6rv"] Jul 09 04:34:00.063637 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:00.063618 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c7b4db4ff-xf6rv"] Jul 09 04:34:01.442260 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:01.442224 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" path="/var/lib/kubelet/pods/a18de6dc-65e5-48fb-b423-888b7fe8bacf/volumes" Jul 09 04:34:06.064787 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:06.064755 2561 generic.go:356] "Generic (PLEG): container finished" podID="8e50bb80-b6ba-408d-9101-6ae231296d9b" containerID="3286f6cde75cc7442e460e4c291b6cf2a21639e54792dda9c2bc072a4c48453a" exitCode=0 Jul 09 04:34:06.065181 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:06.064793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" event={"ID":"8e50bb80-b6ba-408d-9101-6ae231296d9b","Type":"ContainerDied","Data":"3286f6cde75cc7442e460e4c291b6cf2a21639e54792dda9c2bc072a4c48453a"} Jul 09 04:34:06.065181 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:06.065104 2561 scope.go:117] "RemoveContainer" containerID="3286f6cde75cc7442e460e4c291b6cf2a21639e54792dda9c2bc072a4c48453a" Jul 09 04:34:07.070421 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:07.070389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jf5g7" event={"ID":"8e50bb80-b6ba-408d-9101-6ae231296d9b","Type":"ContainerStarted","Data":"d782c1052c544378703ed86b509f03f08f157158aeb5ac58e948cece1c419675"} Jul 09 04:34:12.052146 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.052100 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-585cf9b7db-p2f8t" podUID="79513c46-46d8-401b-a8da-3331cb37d68f" containerName="console" containerID="cri-o://e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4" gracePeriod=15 Jul 09 04:34:12.324853 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.324783 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:34:12.504371 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504342 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-serving-cert\") pod \"79513c46-46d8-401b-a8da-3331cb37d68f\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " Jul 09 04:34:12.504559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504379 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-console-config\") pod \"79513c46-46d8-401b-a8da-3331cb37d68f\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " Jul 09 04:34:12.504559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504405 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-service-ca\") pod \"79513c46-46d8-401b-a8da-3331cb37d68f\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " Jul 09 04:34:12.504559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504426 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-oauth-config\") pod \"79513c46-46d8-401b-a8da-3331cb37d68f\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " Jul 09 04:34:12.504559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504474 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-oauth-serving-cert\") pod \"79513c46-46d8-401b-a8da-3331cb37d68f\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " Jul 09 04:34:12.504559 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504521 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxh88\" (UniqueName: \"kubernetes.io/projected/79513c46-46d8-401b-a8da-3331cb37d68f-kube-api-access-jxh88\") pod \"79513c46-46d8-401b-a8da-3331cb37d68f\" (UID: \"79513c46-46d8-401b-a8da-3331cb37d68f\") " Jul 09 04:34:12.504852 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504800 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-console-config" (OuterVolumeSpecName: "console-config") pod "79513c46-46d8-401b-a8da-3331cb37d68f" (UID: "79513c46-46d8-401b-a8da-3331cb37d68f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:12.504852 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504813 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-service-ca" (OuterVolumeSpecName: "service-ca") pod "79513c46-46d8-401b-a8da-3331cb37d68f" (UID: "79513c46-46d8-401b-a8da-3331cb37d68f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:12.504955 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.504822 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "79513c46-46d8-401b-a8da-3331cb37d68f" (UID: "79513c46-46d8-401b-a8da-3331cb37d68f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:12.506769 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.506736 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "79513c46-46d8-401b-a8da-3331cb37d68f" (UID: "79513c46-46d8-401b-a8da-3331cb37d68f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:12.506868 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.506794 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79513c46-46d8-401b-a8da-3331cb37d68f-kube-api-access-jxh88" (OuterVolumeSpecName: "kube-api-access-jxh88") pod "79513c46-46d8-401b-a8da-3331cb37d68f" (UID: "79513c46-46d8-401b-a8da-3331cb37d68f"). InnerVolumeSpecName "kube-api-access-jxh88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:34:12.508332 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.506960 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "79513c46-46d8-401b-a8da-3331cb37d68f" (UID: "79513c46-46d8-401b-a8da-3331cb37d68f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:12.606022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.605949 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:12.606022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.605975 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-console-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:12.606022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.605985 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:12.606022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.605993 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/79513c46-46d8-401b-a8da-3331cb37d68f-console-oauth-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:12.606022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.606003 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/79513c46-46d8-401b-a8da-3331cb37d68f-oauth-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:12.606022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:12.606012 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxh88\" (UniqueName: \"kubernetes.io/projected/79513c46-46d8-401b-a8da-3331cb37d68f-kube-api-access-jxh88\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:13.102076 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.102041 2561 generic.go:356] "Generic (PLEG): container finished" podID="79513c46-46d8-401b-a8da-3331cb37d68f" containerID="e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4" exitCode=0 Jul 09 04:34:13.102542 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.102102 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585cf9b7db-p2f8t" Jul 09 04:34:13.102542 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.102118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cf9b7db-p2f8t" event={"ID":"79513c46-46d8-401b-a8da-3331cb37d68f","Type":"ContainerDied","Data":"e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4"} Jul 09 04:34:13.102542 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.102194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585cf9b7db-p2f8t" event={"ID":"79513c46-46d8-401b-a8da-3331cb37d68f","Type":"ContainerDied","Data":"8b6a2a8d151bce0cf9da95560669e450c54533acab8b25becbb47b3f6cfcefc7"} Jul 09 04:34:13.102542 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.102213 2561 scope.go:117] "RemoveContainer" containerID="e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4" Jul 09 04:34:13.110844 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.110829 2561 scope.go:117] "RemoveContainer" containerID="e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4" Jul 09 04:34:13.111078 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:13.111062 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4\": container with ID starting with e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4 not found: ID does not exist" containerID="e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4" Jul 09 04:34:13.111117 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.111086 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4"} err="failed to get container status \"e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4\": rpc error: code = NotFound desc = could not find container \"e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4\": container with ID starting with e94411d7ceefe8e6f9f5fbcf7ae76fce0baa910671e3dec5980cce433e94b8c4 not found: ID does not exist" Jul 09 04:34:13.125962 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.125933 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-585cf9b7db-p2f8t"] Jul 09 04:34:13.127840 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.127823 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-585cf9b7db-p2f8t"] Jul 09 04:34:13.441549 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:13.441521 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79513c46-46d8-401b-a8da-3331cb37d68f" path="/var/lib/kubelet/pods/79513c46-46d8-401b-a8da-3331cb37d68f/volumes" Jul 09 04:34:34.919264 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:34.919229 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:34.934401 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:34.934380 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:35.197956 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:35.197890 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:52.965420 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965339 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:34:52.965931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965648 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="prometheus" containerID="cri-o://b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" gracePeriod=600 Jul 09 04:34:52.965931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965680 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy" containerID="cri-o://af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" gracePeriod=600 Jul 09 04:34:52.965931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965694 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="thanos-sidecar" containerID="cri-o://e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" gracePeriod=600 Jul 09 04:34:52.965931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965716 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="config-reloader" containerID="cri-o://c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" gracePeriod=600 Jul 09 04:34:52.965931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965739 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-web" containerID="cri-o://d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" gracePeriod=600 Jul 09 04:34:52.965931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:52.965719 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" gracePeriod=600 Jul 09 04:34:53.213980 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.213956 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.258830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258753 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" exitCode=0 Jul 09 04:34:53.258830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258787 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" exitCode=0 Jul 09 04:34:53.258830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258796 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" exitCode=0 Jul 09 04:34:53.258830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258804 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" exitCode=0 Jul 09 04:34:53.258830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258813 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" exitCode=0 Jul 09 04:34:53.258830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258821 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" exitCode=0 Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258847 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.258977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.259009 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.259019 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.259061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} Jul 09 04:34:53.259127 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.259103 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} Jul 09 04:34:53.259514 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.259140 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f","Type":"ContainerDied","Data":"c28957915ec37e3a74f30f41aeab4da3e7412e69f5af49dd5fd5ee0d5c04bbf0"} Jul 09 04:34:53.267519 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.267487 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.274885 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.274865 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.281550 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.281522 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.288890 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.288873 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.295387 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.295363 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.302326 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.302304 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.308982 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.308965 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.309260 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.309236 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.309352 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.309270 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} err="failed to get container status \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" Jul 09 04:34:53.309352 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.309310 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.309547 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.309533 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.309586 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.309551 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} err="failed to get container status \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" Jul 09 04:34:53.309586 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.309566 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.309778 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.309753 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.309825 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.309783 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} err="failed to get container status \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" Jul 09 04:34:53.309825 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.309798 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.310043 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.310022 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.310126 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310046 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} err="failed to get container status \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" Jul 09 04:34:53.310126 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310063 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.310272 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.310257 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.310341 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310274 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} err="failed to get container status \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" Jul 09 04:34:53.310341 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310312 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.310518 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.310504 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.310563 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310520 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} err="failed to get container status \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" Jul 09 04:34:53.310563 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310533 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.310753 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:34:53.310739 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.310802 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310755 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} err="failed to get container status \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" Jul 09 04:34:53.310802 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310767 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.310992 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310974 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} err="failed to get container status \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" Jul 09 04:34:53.310992 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.310992 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.311172 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311158 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} err="failed to get container status \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" Jul 09 04:34:53.311213 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311172 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.311355 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311340 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} err="failed to get container status \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" Jul 09 04:34:53.311355 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311355 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.311536 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311522 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} err="failed to get container status \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" Jul 09 04:34:53.311581 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311536 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.311721 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311702 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} err="failed to get container status \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" Jul 09 04:34:53.311766 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311723 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.311879 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311864 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} err="failed to get container status \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" Jul 09 04:34:53.311931 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.311880 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.312031 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312017 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} err="failed to get container status \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" Jul 09 04:34:53.312075 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312031 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.312164 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312150 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} err="failed to get container status \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" Jul 09 04:34:53.312202 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312164 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.312351 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312332 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} err="failed to get container status \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" Jul 09 04:34:53.312399 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312353 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.312570 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312551 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} err="failed to get container status \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" Jul 09 04:34:53.312614 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312570 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.312772 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312756 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} err="failed to get container status \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" Jul 09 04:34:53.312812 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312772 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.312992 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312973 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} err="failed to get container status \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" Jul 09 04:34:53.313032 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.312992 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.313180 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313165 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} err="failed to get container status \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" Jul 09 04:34:53.313220 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313181 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.313410 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313388 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} err="failed to get container status \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" Jul 09 04:34:53.313410 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313409 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.313612 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313595 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} err="failed to get container status \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" Jul 09 04:34:53.313654 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313612 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.313843 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313825 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} err="failed to get container status \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" Jul 09 04:34:53.313895 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.313843 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.314035 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314020 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} err="failed to get container status \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" Jul 09 04:34:53.314081 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314035 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.314253 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314233 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} err="failed to get container status \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" Jul 09 04:34:53.314348 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314253 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.314475 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314460 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} err="failed to get container status \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" Jul 09 04:34:53.314518 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314476 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.314703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314686 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} err="failed to get container status \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" Jul 09 04:34:53.314703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314702 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.314899 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314884 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} err="failed to get container status \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" Jul 09 04:34:53.314942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.314899 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.315117 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315102 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} err="failed to get container status \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" Jul 09 04:34:53.315117 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315117 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.315344 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315327 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} err="failed to get container status \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" Jul 09 04:34:53.315396 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315344 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.315525 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315511 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} err="failed to get container status \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" Jul 09 04:34:53.315562 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315525 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.315703 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315689 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} err="failed to get container status \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" Jul 09 04:34:53.315797 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315703 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.315901 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315887 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} err="failed to get container status \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" Jul 09 04:34:53.315901 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.315900 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.316111 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316094 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} err="failed to get container status \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" Jul 09 04:34:53.316149 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316111 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.316343 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316326 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} err="failed to get container status \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" Jul 09 04:34:53.316425 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316344 2561 scope.go:117] "RemoveContainer" containerID="9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303" Jul 09 04:34:53.316577 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316559 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303"} err="failed to get container status \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": rpc error: code = NotFound desc = could not find container \"9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303\": container with ID starting with 9a76da294f54ab30fae3fcb654ae502d9ff79435de4c6038941627ef06bd1303 not found: ID does not exist" Jul 09 04:34:53.316623 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316577 2561 scope.go:117] "RemoveContainer" containerID="af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf" Jul 09 04:34:53.316805 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316789 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf"} err="failed to get container status \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": rpc error: code = NotFound desc = could not find container \"af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf\": container with ID starting with af8b2c553dfcdf7c06c003e1faeddff2b0233640924de2e5c1642696ffdf44cf not found: ID does not exist" Jul 09 04:34:53.316850 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316805 2561 scope.go:117] "RemoveContainer" containerID="d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365" Jul 09 04:34:53.317010 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.316994 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365"} err="failed to get container status \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": rpc error: code = NotFound desc = could not find container \"d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365\": container with ID starting with d6615ea7deb62ecaf6cbea759d36a335a39ccca4c95059fb523f20de85b27365 not found: ID does not exist" Jul 09 04:34:53.317055 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317010 2561 scope.go:117] "RemoveContainer" containerID="e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6" Jul 09 04:34:53.317207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317189 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6"} err="failed to get container status \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": rpc error: code = NotFound desc = could not find container \"e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6\": container with ID starting with e51c1b40079265d6690d120f7a98aa2566a4c83c42f8fe1e8eba07f8d95e40e6 not found: ID does not exist" Jul 09 04:34:53.317253 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317208 2561 scope.go:117] "RemoveContainer" containerID="c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e" Jul 09 04:34:53.317464 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317438 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e"} err="failed to get container status \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": rpc error: code = NotFound desc = could not find container \"c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e\": container with ID starting with c5ef359aff092f8eaf9f32c06d5cca7e9295513c82997e77372bc1346de3ec0e not found: ID does not exist" Jul 09 04:34:53.317464 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317463 2561 scope.go:117] "RemoveContainer" containerID="b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4" Jul 09 04:34:53.317681 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317659 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4"} err="failed to get container status \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": rpc error: code = NotFound desc = could not find container \"b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4\": container with ID starting with b3ba972db02d30ff570f6882cc352190c5f3ca7c3e4e3db27665928f18e588c4 not found: ID does not exist" Jul 09 04:34:53.317726 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317681 2561 scope.go:117] "RemoveContainer" containerID="5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961" Jul 09 04:34:53.317908 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.317891 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961"} err="failed to get container status \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": rpc error: code = NotFound desc = could not find container \"5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961\": container with ID starting with 5418532e8f90778b7d1b0233c9c7eade8595205b5bc4623560ad6fad400b2961 not found: ID does not exist" Jul 09 04:34:53.335318 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335281 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-kube-rbac-proxy\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335413 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335335 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-2\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335413 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335377 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-trusted-ca-bundle\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335413 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335398 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j24n\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-kube-api-access-8j24n\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335526 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335416 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-grpc-tls\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335589 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335566 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-thanos-prometheus-http-client-file\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335642 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-metrics-client-certs\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335699 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335664 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config-out\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335751 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335703 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-metrics-client-ca\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335751 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335723 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.335751 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335737 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335780 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-tls-assets\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335804 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-web-config\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335835 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.335896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335877 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335904 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-serving-certs-ca-bundle\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335943 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-tls\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.335991 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-1\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336021 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-0\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336066 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-db\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336111 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-kubelet-serving-ca-bundle\") pod \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\" (UID: \"3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f\") " Jul 09 04:34:53.336366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336119 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.336366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336407 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.336366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336425 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.336926 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.336814 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.337367 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.337343 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.337902 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.337878 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.338278 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.338250 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.338278 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.338266 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.338466 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.338377 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-kube-api-access-8j24n" (OuterVolumeSpecName: "kube-api-access-8j24n") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "kube-api-access-8j24n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:34:53.338466 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.338402 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.339444 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339417 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config-out" (OuterVolumeSpecName: "config-out") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:34:53.339594 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339563 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:34:53.339686 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339657 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:34:53.339745 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339719 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.339932 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339909 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.340025 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339928 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.340025 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.339937 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.340271 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.340244 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:34:53.340679 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.340662 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config" (OuterVolumeSpecName: "config") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.341229 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.341205 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.350923 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.350895 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-web-config" (OuterVolumeSpecName: "web-config") pod "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" (UID: "3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:34:53.437550 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437519 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437550 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437547 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437550 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437558 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437567 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437578 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437586 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-prometheus-k8s-db\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437594 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437603 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-kube-rbac-proxy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437611 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j24n\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-kube-api-access-8j24n\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437621 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-grpc-tls\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437629 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437637 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-metrics-client-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437645 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config-out\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437653 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-configmap-metrics-client-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437661 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437674 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-tls-assets\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437687 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-web-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.437762 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.437695 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:34:53.576848 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.576747 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:34:53.581378 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.581354 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:34:53.604653 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604628 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:34:53.604916 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604904 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="config-reloader" Jul 09 04:34:53.604959 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604917 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="config-reloader" Jul 09 04:34:53.604959 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604928 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="prometheus" Jul 09 04:34:53.604959 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604933 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="prometheus" Jul 09 04:34:53.604959 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604941 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy" Jul 09 04:34:53.604959 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604947 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604968 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79513c46-46d8-401b-a8da-3331cb37d68f" containerName="console" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604973 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79513c46-46d8-401b-a8da-3331cb37d68f" containerName="console" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604981 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="thanos-sidecar" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604986 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="thanos-sidecar" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604993 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="init-config-reloader" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.604998 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="init-config-reloader" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605007 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" containerName="registry" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605012 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" containerName="registry" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605019 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-web" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605023 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-web" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605029 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-thanos" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605034 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-thanos" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605076 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-thanos" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605083 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="thanos-sidecar" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605091 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18de6dc-65e5-48fb-b423-888b7fe8bacf" containerName="registry" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605095 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79513c46-46d8-401b-a8da-3331cb37d68f" containerName="console" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605100 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="prometheus" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605105 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="config-reloader" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605110 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy" Jul 09 04:34:53.605120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.605116 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" containerName="kube-rbac-proxy-web" Jul 09 04:34:53.610084 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.610068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.612427 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612409 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 04:34:53.612701 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 04:34:53.612782 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612735 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 04:34:53.612782 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612759 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qq9c7\"" Jul 09 04:34:53.612965 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 04:34:53.612965 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6kv9an3j7rl8v\"" Jul 09 04:34:53.612965 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 04:34:53.612965 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.612930 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 04:34:53.613242 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.613040 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 04:34:53.613360 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.613277 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 04:34:53.613446 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.613430 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 04:34:53.613533 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.613516 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 04:34:53.613705 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.613688 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 04:34:53.614043 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.614011 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 04:34:53.614136 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.614077 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 04:34:53.616032 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.616014 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 04:34:53.622412 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.622392 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 04:34:53.627465 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.627446 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:34:53.740036 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.739989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740036 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740259 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740259 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740259 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740259 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740259 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740259 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9r2\" (UniqueName: \"kubernetes.io/projected/550806ed-1570-4845-a6c8-de5c92a1ad11-kube-api-access-tz9r2\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-config\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-web-config\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/550806ed-1570-4845-a6c8-de5c92a1ad11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740484 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/550806ed-1570-4845-a6c8-de5c92a1ad11-config-out\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.740778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.740671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841465 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841465 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9r2\" (UniqueName: \"kubernetes.io/projected/550806ed-1570-4845-a6c8-de5c92a1ad11-kube-api-access-tz9r2\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841465 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-config\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-web-config\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/550806ed-1570-4845-a6c8-de5c92a1ad11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/550806ed-1570-4845-a6c8-de5c92a1ad11-config-out\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.841808 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.841984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.842020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842258 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.842042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842670 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.842583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842832 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.842806 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.842913 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.842891 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.843773 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.843748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/550806ed-1570-4845-a6c8-de5c92a1ad11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844638 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844672 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-web-config\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-config\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.844951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.844938 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.845375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.845933 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.845512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.846069 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.846044 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.846856 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.846826 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.847048 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.847025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.847129 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.847081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/550806ed-1570-4845-a6c8-de5c92a1ad11-config-out\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.847336 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.847319 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/550806ed-1570-4845-a6c8-de5c92a1ad11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.847948 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.847931 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/550806ed-1570-4845-a6c8-de5c92a1ad11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.850045 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.850029 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9r2\" (UniqueName: \"kubernetes.io/projected/550806ed-1570-4845-a6c8-de5c92a1ad11-kube-api-access-tz9r2\") pod \"prometheus-k8s-0\" (UID: \"550806ed-1570-4845-a6c8-de5c92a1ad11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:53.924745 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:53.924713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:34:54.064687 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:54.064659 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 04:34:54.067512 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:34:54.067485 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550806ed_1570_4845_a6c8_de5c92a1ad11.slice/crio-60cfac4f977bfca321ab58ec8d1f6d4495d9589fc40cd33e503ef6c1b4d29e33 WatchSource:0}: Error finding container 60cfac4f977bfca321ab58ec8d1f6d4495d9589fc40cd33e503ef6c1b4d29e33: Status 404 returned error can't find the container with id 60cfac4f977bfca321ab58ec8d1f6d4495d9589fc40cd33e503ef6c1b4d29e33 Jul 09 04:34:54.265578 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:54.265540 2561 generic.go:356] "Generic (PLEG): container finished" podID="550806ed-1570-4845-a6c8-de5c92a1ad11" containerID="16174a2a86ed8cf58d57a64eb097475af227293cec2e87e26afcffcda55802fc" exitCode=0 Jul 09 04:34:54.265740 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:54.265629 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerDied","Data":"16174a2a86ed8cf58d57a64eb097475af227293cec2e87e26afcffcda55802fc"} Jul 09 04:34:54.265740 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:54.265705 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"60cfac4f977bfca321ab58ec8d1f6d4495d9589fc40cd33e503ef6c1b4d29e33"} Jul 09 04:34:55.272905 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.272818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"bb97ccc1898a49903be6d873e2d8accdbfee4f451260e44fe099e972860fa0c0"} Jul 09 04:34:55.272905 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.272879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"2edd66ee29e13bcb2ac8ae8c42cf89fd498757766faad54b2a7de709d166934e"} Jul 09 04:34:55.273322 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.272908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"530d70413f915e37e06947837e582c1a826ffdb3f9730b01330ed66148b8fd10"} Jul 09 04:34:55.273322 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.272933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"33803fb05f140f1fb3a03038a89e3143405d130be244e6563c83fec517dfc5bc"} Jul 09 04:34:55.273322 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.272956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"d76091a813be5573217a7b69af4ce8a09b4e301a3176743df996dc84506b7f8c"} Jul 09 04:34:55.273322 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.272983 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"550806ed-1570-4845-a6c8-de5c92a1ad11","Type":"ContainerStarted","Data":"1bd6f56c578baf758fe55250b2699ef9b98433f14dc083a585a2ee7db988711a"} Jul 09 04:34:55.301002 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.300933 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.27969622 podStartE2EDuration="2.300913964s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.217744ms" isStatefulPod=false podCreationTimestamp="2026-07-09 04:34:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:34:55.298641974 +0000 UTC m=+176.447687542" watchObservedRunningTime="2026-07-09 04:34:55.300913964 +0000 UTC m=+176.449959534" Jul 09 04:34:55.442188 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:55.442155 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f" path="/var/lib/kubelet/pods/3d56fe9c-4e24-4526-bd0a-54dcdad0bd8f/volumes" Jul 09 04:34:58.925647 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:34:58.925610 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:35:07.047275 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:07.047243 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6b65f5c5-r67ws"] Jul 09 04:35:32.069933 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.069870 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f6b65f5c5-r67ws" podUID="0d0aa8e2-d01f-4c46-a631-726773b6afcd" containerName="console" containerID="cri-o://3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a" gracePeriod=15 Jul 09 04:35:32.321767 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.321695 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:35:32.377273 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377243 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-config\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377316 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-service-ca\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377346 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-oauth-serving-cert\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377362 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-trusted-ca-bundle\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377381 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-serving-cert\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377414 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-oauth-config\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377689 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377477 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9r4n\" (UniqueName: \"kubernetes.io/projected/0d0aa8e2-d01f-4c46-a631-726773b6afcd-kube-api-access-g9r4n\") pod \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\" (UID: \"0d0aa8e2-d01f-4c46-a631-726773b6afcd\") " Jul 09 04:35:32.377689 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377641 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-config" (OuterVolumeSpecName: "console-config") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:35:32.377879 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377860 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:32.377973 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377924 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:35:32.377973 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377944 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:35:32.378064 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.377958 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:35:32.379720 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.379689 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:35:32.379818 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.379743 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d0aa8e2-d01f-4c46-a631-726773b6afcd-kube-api-access-g9r4n" (OuterVolumeSpecName: "kube-api-access-g9r4n") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "kube-api-access-g9r4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:35:32.379866 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.379817 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d0aa8e2-d01f-4c46-a631-726773b6afcd" (UID: "0d0aa8e2-d01f-4c46-a631-726773b6afcd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:35:32.425575 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.425540 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d0aa8e2-d01f-4c46-a631-726773b6afcd" containerID="3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a" exitCode=0 Jul 09 04:35:32.425726 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.425589 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6b65f5c5-r67ws" Jul 09 04:35:32.425726 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.425629 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6b65f5c5-r67ws" event={"ID":"0d0aa8e2-d01f-4c46-a631-726773b6afcd","Type":"ContainerDied","Data":"3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a"} Jul 09 04:35:32.425726 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.425694 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6b65f5c5-r67ws" event={"ID":"0d0aa8e2-d01f-4c46-a631-726773b6afcd","Type":"ContainerDied","Data":"2e35f9697a393e07dd32bb3e684d2fccc6bae0e4f6eec1a7838e84f9da4ee68d"} Jul 09 04:35:32.425726 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.425722 2561 scope.go:117] "RemoveContainer" containerID="3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a" Jul 09 04:35:32.434216 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.434201 2561 scope.go:117] "RemoveContainer" containerID="3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a" Jul 09 04:35:32.434495 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:35:32.434474 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a\": container with ID starting with 3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a not found: ID does not exist" containerID="3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a" Jul 09 04:35:32.434548 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.434503 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a"} err="failed to get container status \"3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a\": rpc error: code = NotFound desc = could not find container \"3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a\": container with ID starting with 3f0d19c9260fbef3b12681f4814f674f20762f63983061107ec2c6fc5f65ff4a not found: ID does not exist" Jul 09 04:35:32.444980 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.444959 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6b65f5c5-r67ws"] Jul 09 04:35:32.450814 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.450794 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6b65f5c5-r67ws"] Jul 09 04:35:32.478637 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.478612 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-service-ca\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:32.478637 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.478633 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-oauth-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:32.478768 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.478643 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d0aa8e2-d01f-4c46-a631-726773b6afcd-trusted-ca-bundle\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:32.478768 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.478653 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-serving-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:32.478768 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.478662 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d0aa8e2-d01f-4c46-a631-726773b6afcd-console-oauth-config\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:32.478768 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:32.478670 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9r4n\" (UniqueName: \"kubernetes.io/projected/0d0aa8e2-d01f-4c46-a631-726773b6afcd-kube-api-access-g9r4n\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:35:33.441275 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:33.441236 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d0aa8e2-d01f-4c46-a631-726773b6afcd" path="/var/lib/kubelet/pods/0d0aa8e2-d01f-4c46-a631-726773b6afcd/volumes" Jul 09 04:35:53.925252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:53.925224 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:35:53.940540 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:53.940512 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:35:54.522461 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:35:54.522435 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 04:36:59.353970 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:36:59.353936 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:36:59.358491 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:36:59.358469 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:36:59.365679 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:36:59.365657 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 04:37:48.513201 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.513165 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf"] Jul 09 04:37:48.513655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.513471 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d0aa8e2-d01f-4c46-a631-726773b6afcd" containerName="console" Jul 09 04:37:48.513655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.513481 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d0aa8e2-d01f-4c46-a631-726773b6afcd" containerName="console" Jul 09 04:37:48.513655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.513543 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d0aa8e2-d01f-4c46-a631-726773b6afcd" containerName="console" Jul 09 04:37:48.516481 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.516465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.518943 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.518913 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 04:37:48.519063 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.518917 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mbtt4\"" Jul 09 04:37:48.519777 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.519763 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:37:48.524085 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.524061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf"] Jul 09 04:37:48.588424 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.588399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf4br\" (UniqueName: \"kubernetes.io/projected/df01b4cd-82ac-4d91-bb9c-ae8e675d2f77-kube-api-access-cf4br\") pod \"openshift-lws-operator-fd8ccff4c-fz8pf\" (UID: \"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.588568 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.588459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df01b4cd-82ac-4d91-bb9c-ae8e675d2f77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fz8pf\" (UID: \"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.688813 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.688781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf4br\" (UniqueName: \"kubernetes.io/projected/df01b4cd-82ac-4d91-bb9c-ae8e675d2f77-kube-api-access-cf4br\") pod \"openshift-lws-operator-fd8ccff4c-fz8pf\" (UID: \"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.688948 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.688838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df01b4cd-82ac-4d91-bb9c-ae8e675d2f77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fz8pf\" (UID: \"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.689182 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.689164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df01b4cd-82ac-4d91-bb9c-ae8e675d2f77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fz8pf\" (UID: \"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.696577 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.696556 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf4br\" (UniqueName: \"kubernetes.io/projected/df01b4cd-82ac-4d91-bb9c-ae8e675d2f77-kube-api-access-cf4br\") pod \"openshift-lws-operator-fd8ccff4c-fz8pf\" (UID: \"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.835317 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.835221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" Jul 09 04:37:48.963033 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.962989 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf"] Jul 09 04:37:48.965869 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:37:48.965839 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf01b4cd_82ac_4d91_bb9c_ae8e675d2f77.slice/crio-a1f6769676703accc0681541a7fc2b5924be166444b7c144c439004735dbb815 WatchSource:0}: Error finding container a1f6769676703accc0681541a7fc2b5924be166444b7c144c439004735dbb815: Status 404 returned error can't find the container with id a1f6769676703accc0681541a7fc2b5924be166444b7c144c439004735dbb815 Jul 09 04:37:48.967742 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:48.967728 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:37:49.950271 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:49.950227 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" event={"ID":"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77","Type":"ContainerStarted","Data":"a1f6769676703accc0681541a7fc2b5924be166444b7c144c439004735dbb815"} Jul 09 04:37:51.961493 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:51.961460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" event={"ID":"df01b4cd-82ac-4d91-bb9c-ae8e675d2f77","Type":"ContainerStarted","Data":"9a9437ee57720457a1ae74d6c4bb7d3aef1672dc4d0b660ccf6c9ff57c3d46aa"} Jul 09 04:37:51.977299 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:37:51.977242 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fz8pf" podStartSLOduration=1.614043486 podStartE2EDuration="3.977226694s" totalImagesPullingTime="2.363183208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:51.976624701 +0000 UTC m=+353.125670278" watchObservedRunningTime="2026-07-09 04:37:51.977226694 +0000 UTC m=+353.126272263" Jul 09 04:38:05.024887 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.024855 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc"] Jul 09 04:38:05.028324 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.028302 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.033190 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.033173 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 04:38:05.034146 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.034126 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 04:38:05.034446 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.034429 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 04:38:05.038012 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.037994 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wlsjh\"" Jul 09 04:38:05.061193 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.061165 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc"] Jul 09 04:38:05.127781 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.127748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqzk2\" (UniqueName: \"kubernetes.io/projected/9850c565-95aa-4835-9995-476d6b4dc0e2-kube-api-access-mqzk2\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.127781 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.127783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9850c565-95aa-4835-9995-476d6b4dc0e2-cert\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.127994 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.127879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9850c565-95aa-4835-9995-476d6b4dc0e2-manager-config\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.127994 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.127918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9850c565-95aa-4835-9995-476d6b4dc0e2-metrics-cert\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.228712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.228681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9850c565-95aa-4835-9995-476d6b4dc0e2-manager-config\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.228889 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.228722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9850c565-95aa-4835-9995-476d6b4dc0e2-metrics-cert\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.228889 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.228754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqzk2\" (UniqueName: \"kubernetes.io/projected/9850c565-95aa-4835-9995-476d6b4dc0e2-kube-api-access-mqzk2\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.228889 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.228879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9850c565-95aa-4835-9995-476d6b4dc0e2-cert\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.229478 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.229452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9850c565-95aa-4835-9995-476d6b4dc0e2-manager-config\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.231303 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.231266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9850c565-95aa-4835-9995-476d6b4dc0e2-cert\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.231423 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.231362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9850c565-95aa-4835-9995-476d6b4dc0e2-metrics-cert\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.236534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.236507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqzk2\" (UniqueName: \"kubernetes.io/projected/9850c565-95aa-4835-9995-476d6b4dc0e2-kube-api-access-mqzk2\") pod \"lws-controller-manager-5895bc645c-9pcxc\" (UID: \"9850c565-95aa-4835-9995-476d6b4dc0e2\") " pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.338113 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.338012 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:05.470623 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:05.470598 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc"] Jul 09 04:38:05.472953 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:38:05.472924 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9850c565_95aa_4835_9995_476d6b4dc0e2.slice/crio-debfdf0da7be6d7f6fa1e7a9d2b2247278fe07ac6340449ac47574156e55dd6b WatchSource:0}: Error finding container debfdf0da7be6d7f6fa1e7a9d2b2247278fe07ac6340449ac47574156e55dd6b: Status 404 returned error can't find the container with id debfdf0da7be6d7f6fa1e7a9d2b2247278fe07ac6340449ac47574156e55dd6b Jul 09 04:38:06.020415 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:06.020380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" event={"ID":"9850c565-95aa-4835-9995-476d6b4dc0e2","Type":"ContainerStarted","Data":"debfdf0da7be6d7f6fa1e7a9d2b2247278fe07ac6340449ac47574156e55dd6b"} Jul 09 04:38:08.031552 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.031519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" event={"ID":"9850c565-95aa-4835-9995-476d6b4dc0e2","Type":"ContainerStarted","Data":"8531448b7298d539048aa8b7c01fffcb1aa415b23c40dac476a2da6858e1cf8f"} Jul 09 04:38:08.031935 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.031584 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:08.050136 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.050084 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" podStartSLOduration=2.407833842 podStartE2EDuration="4.050067585s" totalImagesPullingTime="1.642233743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:08.048525087 +0000 UTC m=+369.197570656" watchObservedRunningTime="2026-07-09 04:38:08.050067585 +0000 UTC m=+369.199113155" Jul 09 04:38:08.371270 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.371238 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t"] Jul 09 04:38:08.374652 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.374636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.378099 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.378080 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 04:38:08.378457 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.378439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w4cln\"" Jul 09 04:38:08.379395 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.379377 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 04:38:08.379471 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.379379 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 04:38:08.379519 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.379505 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 04:38:08.418123 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.418096 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t"] Jul 09 04:38:08.554975 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.554946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/064671e1-ea33-477b-973a-c436e7d78703-manifests\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.555153 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.554988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/064671e1-ea33-477b-973a-c436e7d78703-tmp\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.555153 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.555012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064671e1-ea33-477b-973a-c436e7d78703-webhook-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.555153 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.555057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/064671e1-ea33-477b-973a-c436e7d78703-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.555153 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.555090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgb7g\" (UniqueName: \"kubernetes.io/projected/064671e1-ea33-477b-973a-c436e7d78703-kube-api-access-pgb7g\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.656425 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.656333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/064671e1-ea33-477b-973a-c436e7d78703-tmp\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.656425 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.656379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064671e1-ea33-477b-973a-c436e7d78703-webhook-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.656425 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.656402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/064671e1-ea33-477b-973a-c436e7d78703-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.656695 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.656428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgb7g\" (UniqueName: \"kubernetes.io/projected/064671e1-ea33-477b-973a-c436e7d78703-kube-api-access-pgb7g\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.656695 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.656502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/064671e1-ea33-477b-973a-c436e7d78703-manifests\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.656913 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.656889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/064671e1-ea33-477b-973a-c436e7d78703-manifests\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.658864 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.658843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/064671e1-ea33-477b-973a-c436e7d78703-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.659141 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.659123 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/064671e1-ea33-477b-973a-c436e7d78703-tmp\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.659270 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.659252 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/064671e1-ea33-477b-973a-c436e7d78703-webhook-cert\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.665089 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.665062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgb7g\" (UniqueName: \"kubernetes.io/projected/064671e1-ea33-477b-973a-c436e7d78703-kube-api-access-pgb7g\") pod \"opendatahub-operator-controller-manager-94ccb68c4-5wv8t\" (UID: \"064671e1-ea33-477b-973a-c436e7d78703\") " pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.684678 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.684654 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:08.828682 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:08.828658 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t"] Jul 09 04:38:08.831173 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:38:08.831146 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064671e1_ea33_477b_973a_c436e7d78703.slice/crio-abdef0003c30715d26537cdb3bf62eeccb8e63ac808d5e465b9c632f1974f304 WatchSource:0}: Error finding container abdef0003c30715d26537cdb3bf62eeccb8e63ac808d5e465b9c632f1974f304: Status 404 returned error can't find the container with id abdef0003c30715d26537cdb3bf62eeccb8e63ac808d5e465b9c632f1974f304 Jul 09 04:38:09.037503 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:09.037412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" event={"ID":"064671e1-ea33-477b-973a-c436e7d78703","Type":"ContainerStarted","Data":"abdef0003c30715d26537cdb3bf62eeccb8e63ac808d5e465b9c632f1974f304"} Jul 09 04:38:13.058830 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:13.058788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" event={"ID":"064671e1-ea33-477b-973a-c436e7d78703","Type":"ContainerStarted","Data":"c48d33886e94df610584939069e37c11d320995dfcd55c3647e7e79f79e772cb"} Jul 09 04:38:14.064919 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:14.064882 2561 generic.go:356] "Generic (PLEG): container finished" podID="064671e1-ea33-477b-973a-c436e7d78703" containerID="c48d33886e94df610584939069e37c11d320995dfcd55c3647e7e79f79e772cb" exitCode=0 Jul 09 04:38:14.065331 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:14.064943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" event={"ID":"064671e1-ea33-477b-973a-c436e7d78703","Type":"ContainerDied","Data":"c48d33886e94df610584939069e37c11d320995dfcd55c3647e7e79f79e772cb"} Jul 09 04:38:15.071644 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:15.071601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" event={"ID":"064671e1-ea33-477b-973a-c436e7d78703","Type":"ContainerStarted","Data":"80ca92f25d3d4f57fdf473fa442cf28f69ff778c832e37b89e0a7e8102bf4b32"} Jul 09 04:38:15.072064 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:15.071722 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:15.094264 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:15.094211 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" podStartSLOduration=2.501396925 podStartE2EDuration="7.094195331s" totalImagesPullingTime="3.533466586s" totalInitContainerRuntime="1.05933182s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:15.093392266 +0000 UTC m=+376.242437836" watchObservedRunningTime="2026-07-09 04:38:15.094195331 +0000 UTC m=+376.243240902" Jul 09 04:38:19.040485 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:19.040459 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5895bc645c-9pcxc" Jul 09 04:38:26.078892 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:26.078863 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94ccb68c4-5wv8t" Jul 09 04:38:36.120557 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.120518 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm"] Jul 09 04:38:36.130770 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.130747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.133895 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.133873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 04:38:36.134001 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.133983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p4l6v\"" Jul 09 04:38:36.142252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.142228 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm"] Jul 09 04:38:36.171398 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhd5l\" (UniqueName: \"kubernetes.io/projected/dd9baadc-a553-4acb-846a-aa47dc92e238-kube-api-access-fhd5l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171544 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9baadc-a553-4acb-846a-aa47dc92e238-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171748 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.171748 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.171632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.272870 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.272836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhd5l\" (UniqueName: \"kubernetes.io/projected/dd9baadc-a553-4acb-846a-aa47dc92e238-kube-api-access-fhd5l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273021 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.272892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9baadc-a553-4acb-846a-aa47dc92e238-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273021 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.272917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273021 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.272933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273021 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.272958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273021 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.272984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273272 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273272 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273272 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273465 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273392 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273465 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273421 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273590 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273685 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.273778 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.273762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd9baadc-a553-4acb-846a-aa47dc92e238-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.275213 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.275194 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.275512 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.275496 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.280322 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.280298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd9baadc-a553-4acb-846a-aa47dc92e238-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.280523 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.280501 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhd5l\" (UniqueName: \"kubernetes.io/projected/dd9baadc-a553-4acb-846a-aa47dc92e238-kube-api-access-fhd5l\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4fkmvm\" (UID: \"dd9baadc-a553-4acb-846a-aa47dc92e238\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.332014 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.331983 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp"] Jul 09 04:38:36.336595 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.336578 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.339156 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.339137 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 04:38:36.339239 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.339156 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 04:38:36.339311 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.339236 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 04:38:36.339311 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.339264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hd9n5\"" Jul 09 04:38:36.350577 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.350554 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp"] Jul 09 04:38:36.374524 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.374524 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.374712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dca7bc7-c495-48e5-8e71-f367706d4ff2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.374712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.374712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.374712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.374712 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.374692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5mhp\" (UniqueName: \"kubernetes.io/projected/6dca7bc7-c495-48e5-8e71-f367706d4ff2-kube-api-access-w5mhp\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.440610 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.440567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:36.475677 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.475646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.475954 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.475930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.476034 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.476015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dca7bc7-c495-48e5-8e71-f367706d4ff2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.476097 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.476043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.476097 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.476076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.476198 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.476138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.476198 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.476164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5mhp\" (UniqueName: \"kubernetes.io/projected/6dca7bc7-c495-48e5-8e71-f367706d4ff2-kube-api-access-w5mhp\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.476714 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.476684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.478232 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.478207 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.478342 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.478249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dca7bc7-c495-48e5-8e71-f367706d4ff2-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.478903 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.478878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.479017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.479002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6dca7bc7-c495-48e5-8e71-f367706d4ff2-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.483717 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.483695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dca7bc7-c495-48e5-8e71-f367706d4ff2-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.484126 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.484106 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5mhp\" (UniqueName: \"kubernetes.io/projected/6dca7bc7-c495-48e5-8e71-f367706d4ff2-kube-api-access-w5mhp\") pod \"istiod-openshift-gateway-94bb8fbfd-bnvnp\" (UID: \"6dca7bc7-c495-48e5-8e71-f367706d4ff2\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.607525 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.607487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm"] Jul 09 04:38:36.616799 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:38:36.616770 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9baadc_a553_4acb_846a_aa47dc92e238.slice/crio-195d50340abbf52f52e7c514a04f7b23ddcb97ed72ec14cd7a6ba573a8495b00 WatchSource:0}: Error finding container 195d50340abbf52f52e7c514a04f7b23ddcb97ed72ec14cd7a6ba573a8495b00: Status 404 returned error can't find the container with id 195d50340abbf52f52e7c514a04f7b23ddcb97ed72ec14cd7a6ba573a8495b00 Jul 09 04:38:36.646333 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.646254 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:36.787416 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:36.787393 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp"] Jul 09 04:38:36.789111 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:38:36.789091 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dca7bc7_c495_48e5_8e71_f367706d4ff2.slice/crio-0e55171a04b4544b6f568c1cccde7ae50b3efcc7125800333b2b7f477f87698e WatchSource:0}: Error finding container 0e55171a04b4544b6f568c1cccde7ae50b3efcc7125800333b2b7f477f87698e: Status 404 returned error can't find the container with id 0e55171a04b4544b6f568c1cccde7ae50b3efcc7125800333b2b7f477f87698e Jul 09 04:38:37.170017 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:37.169984 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" event={"ID":"dd9baadc-a553-4acb-846a-aa47dc92e238","Type":"ContainerStarted","Data":"195d50340abbf52f52e7c514a04f7b23ddcb97ed72ec14cd7a6ba573a8495b00"} Jul 09 04:38:37.171126 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:37.171093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" event={"ID":"6dca7bc7-c495-48e5-8e71-f367706d4ff2","Type":"ContainerStarted","Data":"0e55171a04b4544b6f568c1cccde7ae50b3efcc7125800333b2b7f477f87698e"} Jul 09 04:38:38.955780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:38.955740 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:38:38.956051 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:38.955804 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:38:39.186816 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:39.186781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" event={"ID":"6dca7bc7-c495-48e5-8e71-f367706d4ff2","Type":"ContainerStarted","Data":"f49d34020977b0bb99861b08270f821f1ccc28a733f1ec9f6ae9ff5037476c0a"} Jul 09 04:38:39.186997 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:39.186912 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:39.216393 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:39.215971 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" podStartSLOduration=1.051590124 podStartE2EDuration="3.215950266s" totalImagesPullingTime="2.164360142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:39.215058564 +0000 UTC m=+400.364104126" watchObservedRunningTime="2026-07-09 04:38:39.215950266 +0000 UTC m=+400.364995840" Jul 09 04:38:40.194997 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:40.194919 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bnvnp" Jul 09 04:38:41.171339 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:41.171304 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:38:41.171448 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:41.171389 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:38:41.171448 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:41.171426 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:38:42.203395 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:42.203359 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" event={"ID":"dd9baadc-a553-4acb-846a-aa47dc92e238","Type":"ContainerStarted","Data":"5297ef62900aa53001b92125df3bad5fda2fa7d6d4074f6daf913c9138b3b024"} Jul 09 04:38:42.223746 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:42.223697 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" podStartSLOduration=1.671364234 podStartE2EDuration="6.223682982s" totalImagesPullingTime="4.552318748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:38:42.221693291 +0000 UTC m=+403.370738860" watchObservedRunningTime="2026-07-09 04:38:42.223682982 +0000 UTC m=+403.372728550" Jul 09 04:38:42.441451 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:42.441419 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:42.445797 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:42.445770 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:43.208348 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:43.208312 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:38:43.209409 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:38:43.209393 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4fkmvm" Jul 09 04:41:22.256067 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.256032 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:41:22.259530 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.259512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.261995 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.261967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ckvp2\"" Jul 09 04:41:22.261995 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.261979 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 04:41:22.262174 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.261967 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 04:41:22.262174 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.262030 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 04:41:22.269598 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.269578 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:41:22.300041 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.300008 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:41:22.307352 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.307334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkszv\" (UniqueName: \"kubernetes.io/projected/b9184d1e-1ccf-4548-83bc-668ca77e34a2-kube-api-access-qkszv\") pod \"limitador-limitador-54d6d988d5-gmrt4\" (UID: \"b9184d1e-1ccf-4548-83bc-668ca77e34a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.307429 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.307400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9184d1e-1ccf-4548-83bc-668ca77e34a2-config-file\") pod \"limitador-limitador-54d6d988d5-gmrt4\" (UID: \"b9184d1e-1ccf-4548-83bc-668ca77e34a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.407989 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.407936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9184d1e-1ccf-4548-83bc-668ca77e34a2-config-file\") pod \"limitador-limitador-54d6d988d5-gmrt4\" (UID: \"b9184d1e-1ccf-4548-83bc-668ca77e34a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.408180 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.408034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkszv\" (UniqueName: \"kubernetes.io/projected/b9184d1e-1ccf-4548-83bc-668ca77e34a2-kube-api-access-qkszv\") pod \"limitador-limitador-54d6d988d5-gmrt4\" (UID: \"b9184d1e-1ccf-4548-83bc-668ca77e34a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.408662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.408639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9184d1e-1ccf-4548-83bc-668ca77e34a2-config-file\") pod \"limitador-limitador-54d6d988d5-gmrt4\" (UID: \"b9184d1e-1ccf-4548-83bc-668ca77e34a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.416031 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.416005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkszv\" (UniqueName: \"kubernetes.io/projected/b9184d1e-1ccf-4548-83bc-668ca77e34a2-kube-api-access-qkszv\") pod \"limitador-limitador-54d6d988d5-gmrt4\" (UID: \"b9184d1e-1ccf-4548-83bc-668ca77e34a2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.570207 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.570127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:22.701548 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.701527 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:41:22.704301 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:41:22.704264 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9184d1e_1ccf_4548_83bc_668ca77e34a2.slice/crio-b904d50a72c49a6f7a49c9c759f4ef8bc61db992036a30fa480857ed2f305ed9 WatchSource:0}: Error finding container b904d50a72c49a6f7a49c9c759f4ef8bc61db992036a30fa480857ed2f305ed9: Status 404 returned error can't find the container with id b904d50a72c49a6f7a49c9c759f4ef8bc61db992036a30fa480857ed2f305ed9 Jul 09 04:41:22.899042 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:22.899005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" event={"ID":"b9184d1e-1ccf-4548-83bc-668ca77e34a2","Type":"ContainerStarted","Data":"b904d50a72c49a6f7a49c9c759f4ef8bc61db992036a30fa480857ed2f305ed9"} Jul 09 04:41:25.914072 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:25.914037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" event={"ID":"b9184d1e-1ccf-4548-83bc-668ca77e34a2","Type":"ContainerStarted","Data":"05c749b6218410752cb4a29aa97fd67e02cc37244bad4a866ddfce686fb9d900"} Jul 09 04:41:25.914477 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:25.914163 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:25.930485 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:25.930440 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" podStartSLOduration=1.347153238 podStartE2EDuration="3.930420863s" totalImagesPullingTime="2.583267625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:41:25.928534468 +0000 UTC m=+567.077580031" watchObservedRunningTime="2026-07-09 04:41:25.930420863 +0000 UTC m=+567.079466431" Jul 09 04:41:36.920613 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:36.920583 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gmrt4" Jul 09 04:41:59.383185 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:59.383158 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:41:59.387050 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:41:59.387026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:42:34.356719 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:42:34.356636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:42:51.840077 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:42:51.840040 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:43:01.612874 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:01.612841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:43:06.724495 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:06.724455 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:43:19.947895 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.947868 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx"] Jul 09 04:43:19.956299 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.956252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:19.960060 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.960019 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx"] Jul 09 04:43:19.960573 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.960551 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 04:43:19.960715 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.960563 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 04:43:19.960715 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.960571 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 04:43:19.960831 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:19.960604 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9g9xn\"" Jul 09 04:43:20.045503 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.045478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e442616-2da6-40d6-aebb-fbbda86e096e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.045655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.045517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.045655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.045534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.045655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.045605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.045655 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.045632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2db72\" (UniqueName: \"kubernetes.io/projected/5e442616-2da6-40d6-aebb-fbbda86e096e-kube-api-access-2db72\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.045831 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.045660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146332 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e442616-2da6-40d6-aebb-fbbda86e096e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146332 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146583 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146583 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146583 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2db72\" (UniqueName: \"kubernetes.io/projected/5e442616-2da6-40d6-aebb-fbbda86e096e-kube-api-access-2db72\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146583 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146794 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146794 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146770 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.146871 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.146816 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.148665 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.148638 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e442616-2da6-40d6-aebb-fbbda86e096e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.148847 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.148833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e442616-2da6-40d6-aebb-fbbda86e096e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.158113 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.158089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2db72\" (UniqueName: \"kubernetes.io/projected/5e442616-2da6-40d6-aebb-fbbda86e096e-kube-api-access-2db72\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx\" (UID: \"5e442616-2da6-40d6-aebb-fbbda86e096e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.270271 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.270204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:20.397551 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.397527 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx"] Jul 09 04:43:20.399853 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:43:20.399827 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e442616_2da6_40d6_aebb_fbbda86e096e.slice/crio-8583d44de516975a327d04d686abbc21a3ef1de07c5fe177141c58eaedab95c9 WatchSource:0}: Error finding container 8583d44de516975a327d04d686abbc21a3ef1de07c5fe177141c58eaedab95c9: Status 404 returned error can't find the container with id 8583d44de516975a327d04d686abbc21a3ef1de07c5fe177141c58eaedab95c9 Jul 09 04:43:20.401205 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.401190 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:43:20.441223 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:20.441196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" event={"ID":"5e442616-2da6-40d6-aebb-fbbda86e096e","Type":"ContainerStarted","Data":"8583d44de516975a327d04d686abbc21a3ef1de07c5fe177141c58eaedab95c9"} Jul 09 04:43:21.618049 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:21.618014 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:43:22.456573 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:22.456539 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" event={"ID":"5e442616-2da6-40d6-aebb-fbbda86e096e","Type":"ContainerStarted","Data":"bcfbf87f52bd965b8bd1671a63b084d839d68082623bd1c86e3a26ce365c58ac"} Jul 09 04:43:22.473988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:22.473944 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" podStartSLOduration=2.4536474679999998 podStartE2EDuration="3.473930125s" totalImagesPullingTime="1.020282657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:43:22.47143783 +0000 UTC m=+683.620483420" watchObservedRunningTime="2026-07-09 04:43:22.473930125 +0000 UTC m=+683.622975693" Jul 09 04:43:30.270596 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:30.270562 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:30.271033 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:30.270656 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:30.283112 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:30.283088 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:30.502252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:30.502219 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx" Jul 09 04:43:39.819582 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:39.819544 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:43:46.226388 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:43:46.226356 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:44:47.537702 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:44:47.537658 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:44:57.315381 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:44:57.315344 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:45:08.217519 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:45:08.217488 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:45:18.017020 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:45:18.016976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:45:27.821691 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:45:27.821601 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:45:55.617160 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:45:55.617126 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:46:07.139007 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:46:07.138964 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:46:42.321448 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:46:42.321412 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:46:51.615783 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:46:51.615708 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:46:59.413294 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:46:59.413264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:46:59.414092 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:46:59.414071 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:47:00.924133 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:00.924103 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:47:06.815481 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:06.815443 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:47:17.222986 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:17.222949 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:47:26.715942 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:26.715904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:47:37.825937 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:37.825903 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:47:47.815561 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:47.815523 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:47:56.929399 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:47:56.929370 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:48:05.426521 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:48:05.426489 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:48:19.919532 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:48:19.919501 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:48:30.019787 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:48:30.019710 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:48:43.519667 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:48:43.519632 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:48:54.630890 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:48:54.630858 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:49:18.020576 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:49:18.020540 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:49:29.217442 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:49:29.217408 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:49:43.425102 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:49:43.425060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:49:53.126476 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:49:53.126395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:50:03.830382 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:50:03.830351 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:50:13.526093 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:50:13.526059 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:50:23.228022 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:50:23.227987 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:51:59.449061 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:51:59.449034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:51:59.449564 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:51:59.449124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:52:08.927489 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:52:08.927452 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:52:19.329391 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:52:19.329357 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:52:30.018777 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:52:30.018744 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:52:40.732662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:52:40.732628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:52:53.018323 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:52:53.018229 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:53:02.322180 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:53:02.322147 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:53:11.720043 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:53:11.720007 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:53:23.122490 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:53:23.122456 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:53:33.223619 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:53:33.223586 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:53:42.225219 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:53:42.225189 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:53:52.923731 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:53:52.923695 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:54:17.325109 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:54:17.325071 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:54:24.818447 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:54:24.818368 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:54:34.522832 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:54:34.522797 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:54:44.220434 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:54:44.220395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:54:51.021700 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:54:51.021668 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:55:06.922950 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:55:06.922919 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:55:16.226217 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:55:16.226180 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:55:25.623255 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:55:25.623221 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:55:35.525872 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:55:35.525836 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:55:46.626415 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:55:46.626367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:55:56.017179 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:55:56.017147 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:56:08.923195 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:08.923166 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:56:18.227195 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:18.227162 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:56:27.931580 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:27.931545 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:56:40.620505 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:40.620469 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:56:51.921719 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:51.921681 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:56:59.475431 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:59.475404 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:56:59.478208 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:56:59.478185 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 04:57:00.319333 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:57:00.319300 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:57:10.822949 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:57:10.822917 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:57:22.924633 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:57:22.924553 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:57:34.322721 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:57:34.322683 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:57:48.019751 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:57:48.019717 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:57:56.821935 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:57:56.821904 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:58:06.361865 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.361830 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l"] Jul 09 04:58:06.365469 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.365450 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.367978 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.367958 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-985e40e4-openshift-default-dockercfg-5dqd2\"" Jul 09 04:58:06.392111 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.392083 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l"] Jul 09 04:58:06.423345 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-socket\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423476 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-credential-socket\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423476 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-token\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423476 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istiod-ca-cert\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423624 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-podinfo\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423624 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-envoy\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423624 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2b7g\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-kube-api-access-s2b7g\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423731 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-certs\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.423731 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.423647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-data\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524552 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-socket\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524552 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524551 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-credential-socket\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-token\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istiod-ca-cert\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-podinfo\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-envoy\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2b7g\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-kube-api-access-s2b7g\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-certs\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.524780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-data\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.525050 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.524987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-credential-socket\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.525050 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.525031 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-socket\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.525119 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.525095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-certs\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.525246 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.525228 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-data\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.525634 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.525613 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istiod-ca-cert\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.527196 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.527175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-envoy\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.527455 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.527437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-podinfo\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.531928 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.531905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2b7g\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-kube-api-access-s2b7g\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.532579 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.532559 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-token\") pod \"e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.676751 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.676716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:06.810139 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.810107 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l"] Jul 09 04:58:06.813645 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:58:06.813617 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c0d5c4_86e0_4961_8656_e34eab1a6789.slice/crio-a1b8cb38978126280902fd1667499c8ca5cff576bb1bfcf393ae7d9c171d2786 WatchSource:0}: Error finding container a1b8cb38978126280902fd1667499c8ca5cff576bb1bfcf393ae7d9c171d2786: Status 404 returned error can't find the container with id a1b8cb38978126280902fd1667499c8ca5cff576bb1bfcf393ae7d9c171d2786 Jul 09 04:58:06.815988 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.815951 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:06.816092 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.816018 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:06.816092 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.816048 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:06.830175 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:06.830157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:58:07.433818 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:07.433781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" event={"ID":"c4c0d5c4-86e0-4961-8656-e34eab1a6789","Type":"ContainerStarted","Data":"51b3bc62dc71b2951f49f5a916bb8ea909dfbfad0944049ce34b00f5c15ec1ae"} Jul 09 04:58:07.434216 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:07.433839 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" event={"ID":"c4c0d5c4-86e0-4961-8656-e34eab1a6789","Type":"ContainerStarted","Data":"a1b8cb38978126280902fd1667499c8ca5cff576bb1bfcf393ae7d9c171d2786"} Jul 09 04:58:07.454160 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:07.454106 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" podStartSLOduration=1.45407648 podStartE2EDuration="1.45407648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:58:07.451985601 +0000 UTC m=+1568.601031170" watchObservedRunningTime="2026-07-09 04:58:07.45407648 +0000 UTC m=+1568.603122063" Jul 09 04:58:07.677077 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:07.677041 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:07.681962 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:07.681937 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:08.438744 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:08.438707 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:08.440222 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:08.440200 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:12.740334 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:12.740297 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l"] Jul 09 04:58:12.740746 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:12.740501 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" podUID="c4c0d5c4-86e0-4961-8656-e34eab1a6789" containerName="istio-proxy" containerID="cri-o://51b3bc62dc71b2951f49f5a916bb8ea909dfbfad0944049ce34b00f5c15ec1ae" gracePeriod=30 Jul 09 04:58:18.486094 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.486062 2561 generic.go:356] "Generic (PLEG): container finished" podID="c4c0d5c4-86e0-4961-8656-e34eab1a6789" containerID="51b3bc62dc71b2951f49f5a916bb8ea909dfbfad0944049ce34b00f5c15ec1ae" exitCode=0 Jul 09 04:58:18.486487 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.486099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" event={"ID":"c4c0d5c4-86e0-4961-8656-e34eab1a6789","Type":"ContainerDied","Data":"51b3bc62dc71b2951f49f5a916bb8ea909dfbfad0944049ce34b00f5c15ec1ae"} Jul 09 04:58:18.486487 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.486155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" event={"ID":"c4c0d5c4-86e0-4961-8656-e34eab1a6789","Type":"ContainerDied","Data":"a1b8cb38978126280902fd1667499c8ca5cff576bb1bfcf393ae7d9c171d2786"} Jul 09 04:58:18.486487 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.486176 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1b8cb38978126280902fd1667499c8ca5cff576bb1bfcf393ae7d9c171d2786" Jul 09 04:58:18.497216 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.497199 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:18.549522 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549466 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2b7g\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-kube-api-access-s2b7g\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549522 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549501 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istiod-ca-cert\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549674 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549534 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-socket\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549674 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549576 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-certs\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549674 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549605 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-token\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549674 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-data\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549674 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549663 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-credential-socket\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549922 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549688 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-envoy\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549922 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549745 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-podinfo\") pod \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\" (UID: \"c4c0d5c4-86e0-4961-8656-e34eab1a6789\") " Jul 09 04:58:18.549922 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549842 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:58:18.550076 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.549945 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:18.550076 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550028 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:18.550076 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550038 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:18.550528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550337 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.550528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550360 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.550528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550376 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.550528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550388 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.550802 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.550540 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:18.552035 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.552012 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-kube-api-access-s2b7g" (OuterVolumeSpecName: "kube-api-access-s2b7g") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "kube-api-access-s2b7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:58:18.552117 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.552077 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:58:18.552247 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.552228 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:58:18.552421 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.552399 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4c0d5c4-86e0-4961-8656-e34eab1a6789" (UID: "c4c0d5c4-86e0-4961-8656-e34eab1a6789"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:18.651713 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.651687 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.651839 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.651717 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.651839 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.651729 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.651839 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.651740 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4c0d5c4-86e0-4961-8656-e34eab1a6789-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.651839 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.651752 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2b7g\" (UniqueName: \"kubernetes.io/projected/c4c0d5c4-86e0-4961-8656-e34eab1a6789-kube-api-access-s2b7g\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:18.961765 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.961736 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5"] Jul 09 04:58:18.962104 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.962091 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c0d5c4-86e0-4961-8656-e34eab1a6789" containerName="istio-proxy" Jul 09 04:58:18.962152 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.962106 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c0d5c4-86e0-4961-8656-e34eab1a6789" containerName="istio-proxy" Jul 09 04:58:18.962204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.962183 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c0d5c4-86e0-4961-8656-e34eab1a6789" containerName="istio-proxy" Jul 09 04:58:18.965537 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.965516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:18.967892 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.967870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9b4ec329-openshift-default-dockercfg-wnx4v\"" Jul 09 04:58:18.978218 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:18.978196 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5"] Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-certs\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-istio-token\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-data\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-envoy\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dd9l\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-kube-api-access-7dd9l\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-credential-socket\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60120d7a-9157-464e-9796-6e90b171640d-istio-podinfo\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.055997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60120d7a-9157-464e-9796-6e90b171640d-istiod-ca-cert\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.056759 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.056030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-socket\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157443 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-certs\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157443 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-istio-token\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-data\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-envoy\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dd9l\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-kube-api-access-7dd9l\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-credential-socket\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60120d7a-9157-464e-9796-6e90b171640d-istio-podinfo\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157664 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60120d7a-9157-464e-9796-6e90b171640d-istiod-ca-cert\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157975 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-socket\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157975 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-data\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.157975 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.157906 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-certs\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.158142 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.158122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-socket\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.158197 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.158140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-credential-socket\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.158253 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.158223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60120d7a-9157-464e-9796-6e90b171640d-istiod-ca-cert\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.159772 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.159752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-envoy\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.159991 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.159972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60120d7a-9157-464e-9796-6e90b171640d-istio-podinfo\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.164980 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.164959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dd9l\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-kube-api-access-7dd9l\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.165825 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.165808 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-istio-token\") pod \"e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.278275 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.278217 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:19.408780 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.408739 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5"] Jul 09 04:58:19.412643 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:58:19.412616 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60120d7a_9157_464e_9796_6e90b171640d.slice/crio-d4b232f1aa4fcb2778f358eef9350443c2b7327f941aaefda71125f4b7b3d463 WatchSource:0}: Error finding container d4b232f1aa4fcb2778f358eef9350443c2b7327f941aaefda71125f4b7b3d463: Status 404 returned error can't find the container with id d4b232f1aa4fcb2778f358eef9350443c2b7327f941aaefda71125f4b7b3d463 Jul 09 04:58:19.415041 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.415009 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:19.415120 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.415076 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:19.415180 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.415121 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:19.493244 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.493215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" event={"ID":"60120d7a-9157-464e-9796-6e90b171640d","Type":"ContainerStarted","Data":"604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37"} Jul 09 04:58:19.493636 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.493256 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l" Jul 09 04:58:19.493636 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.493262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" event={"ID":"60120d7a-9157-464e-9796-6e90b171640d","Type":"ContainerStarted","Data":"d4b232f1aa4fcb2778f358eef9350443c2b7327f941aaefda71125f4b7b3d463"} Jul 09 04:58:19.513158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.513115 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" podStartSLOduration=1.513099306 podStartE2EDuration="1.513099306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:58:19.51139897 +0000 UTC m=+1580.660444552" watchObservedRunningTime="2026-07-09 04:58:19.513099306 +0000 UTC m=+1580.662144934" Jul 09 04:58:19.529912 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.529840 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l"] Jul 09 04:58:19.532553 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:19.532530 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-985e40e4-openshift-default-85d6df6c79-pht5l"] Jul 09 04:58:20.278922 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:20.278891 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:20.283577 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:20.283545 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:20.498106 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:20.498076 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:20.498976 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:20.498955 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:21.443131 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:21.443102 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c0d5c4-86e0-4961-8656-e34eab1a6789" path="/var/lib/kubelet/pods/c4c0d5c4-86e0-4961-8656-e34eab1a6789/volumes" Jul 09 04:58:22.820641 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:22.820615 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:58:30.551730 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:30.551702 2561 generic.go:356] "Generic (PLEG): container finished" podID="60120d7a-9157-464e-9796-6e90b171640d" containerID="604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37" exitCode=0 Jul 09 04:58:30.552068 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:30.551753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" event={"ID":"60120d7a-9157-464e-9796-6e90b171640d","Type":"ContainerDied","Data":"604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37"} Jul 09 04:58:30.552165 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:30.552148 2561 scope.go:117] "RemoveContainer" containerID="604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37" Jul 09 04:58:30.553228 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:30.553202 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:30.553302 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:30.553267 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:30.553349 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:30.553324 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:31.214669 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:31.214637 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5"] Jul 09 04:58:31.557720 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:31.557627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" event={"ID":"60120d7a-9157-464e-9796-6e90b171640d","Type":"ContainerStarted","Data":"277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358"} Jul 09 04:58:31.557720 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:31.557671 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" containerID="cri-o://277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358" gracePeriod=30 Jul 09 04:58:34.317971 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:34.317931 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 04:58:35.498240 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:35.498210 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:36.808700 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.808677 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:36.820526 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820462 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-socket\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820526 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820494 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-envoy\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820526 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dd9l\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-kube-api-access-7dd9l\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820535 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-credential-socket\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820565 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-certs\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820594 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60120d7a-9157-464e-9796-6e90b171640d-istio-podinfo\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820616 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60120d7a-9157-464e-9796-6e90b171640d-istiod-ca-cert\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820683 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-data\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.820754 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-istio-token\") pod \"60120d7a-9157-464e-9796-6e90b171640d\" (UID: \"60120d7a-9157-464e-9796-6e90b171640d\") " Jul 09 04:58:36.821059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820779 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:36.821059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820840 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:36.821059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.820881 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:36.821059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.821034 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.821059 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.821053 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.821332 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.821050 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60120d7a-9157-464e-9796-6e90b171640d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:58:36.821332 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.821069 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.821605 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.821579 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-data" (OuterVolumeSpecName: "istio-data") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:36.822869 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.822825 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-kube-api-access-7dd9l" (OuterVolumeSpecName: "kube-api-access-7dd9l") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "kube-api-access-7dd9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:58:36.822983 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.822892 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:36.822983 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.822921 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60120d7a-9157-464e-9796-6e90b171640d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:58:36.822983 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.822925 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-istio-token" (OuterVolumeSpecName: "istio-token") pod "60120d7a-9157-464e-9796-6e90b171640d" (UID: "60120d7a-9157-464e-9796-6e90b171640d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:58:36.921665 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.921636 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.921665 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.921661 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dd9l\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-kube-api-access-7dd9l\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.921665 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.921674 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60120d7a-9157-464e-9796-6e90b171640d-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.921896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.921682 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60120d7a-9157-464e-9796-6e90b171640d-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.921896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.921690 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60120d7a-9157-464e-9796-6e90b171640d-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:36.921896 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:36.921705 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60120d7a-9157-464e-9796-6e90b171640d-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:37.208643 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.208614 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z"] Jul 09 04:58:37.209473 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.209018 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" Jul 09 04:58:37.209473 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.209037 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" Jul 09 04:58:37.209473 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.209143 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" Jul 09 04:58:37.209473 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.209153 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" Jul 09 04:58:37.212677 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.212659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.214986 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.214967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-610b04b1-openshift-default-dockercfg-pcdh9\"" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.224844 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-certs\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.224882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-credential-socket\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.224913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-podinfo\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.224952 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-token\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.224996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-envoy\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.225025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-socket\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225124 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.225054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7hp\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-kube-api-access-fr7hp\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225481 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.225135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bd5a49-7aad-4b7f-b39b-905d028d8797-istiod-ca-cert\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.225481 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.225174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-data\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.226224 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.226203 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z"] Jul 09 04:58:37.326075 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-token\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-envoy\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-socket\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7hp\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-kube-api-access-fr7hp\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bd5a49-7aad-4b7f-b39b-905d028d8797-istiod-ca-cert\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326252 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-data\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-certs\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-credential-socket\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326534 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-podinfo\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326715 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-socket\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326769 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-data\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326769 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326756 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-certs\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.326872 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.326786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-credential-socket\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.327035 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.327004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bd5a49-7aad-4b7f-b39b-905d028d8797-istiod-ca-cert\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.328528 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.328508 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-envoy\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.328728 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.328712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-podinfo\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.333652 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.333633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-token\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.334079 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.334058 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7hp\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-kube-api-access-fr7hp\") pod \"e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.525707 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.525623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:37.597051 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.597023 2561 generic.go:356] "Generic (PLEG): container finished" podID="60120d7a-9157-464e-9796-6e90b171640d" containerID="277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358" exitCode=0 Jul 09 04:58:37.597197 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.597128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" event={"ID":"60120d7a-9157-464e-9796-6e90b171640d","Type":"ContainerDied","Data":"277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358"} Jul 09 04:58:37.597197 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.597165 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" event={"ID":"60120d7a-9157-464e-9796-6e90b171640d","Type":"ContainerDied","Data":"d4b232f1aa4fcb2778f358eef9350443c2b7327f941aaefda71125f4b7b3d463"} Jul 09 04:58:37.597197 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.597187 2561 scope.go:117] "RemoveContainer" containerID="277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358" Jul 09 04:58:37.597423 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.597395 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5" Jul 09 04:58:37.606072 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.606053 2561 scope.go:117] "RemoveContainer" containerID="604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37" Jul 09 04:58:37.618105 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.616084 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5"] Jul 09 04:58:37.619409 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.619391 2561 scope.go:117] "RemoveContainer" containerID="277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358" Jul 09 04:58:37.619805 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:58:37.619775 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358\": container with ID starting with 277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358 not found: ID does not exist" containerID="277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358" Jul 09 04:58:37.619866 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.619813 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358"} err="failed to get container status \"277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358\": rpc error: code = NotFound desc = could not find container \"277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358\": container with ID starting with 277131c9d702b5357edda6d6d64e3fec26490d1b00070f48b097ead8b3df6358 not found: ID does not exist" Jul 09 04:58:37.619866 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.619840 2561 scope.go:117] "RemoveContainer" containerID="604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37" Jul 09 04:58:37.619866 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.619843 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9b4ec329-openshift-default-84f78cf997-49pw5"] Jul 09 04:58:37.620123 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:58:37.620107 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37\": container with ID starting with 604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37 not found: ID does not exist" containerID="604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37" Jul 09 04:58:37.620188 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.620128 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37"} err="failed to get container status \"604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37\": rpc error: code = NotFound desc = could not find container \"604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37\": container with ID starting with 604bcd27dac2052ba87b85c02416c2df31a1993b021bb82b0c6119eec453db37 not found: ID does not exist" Jul 09 04:58:37.665678 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.665651 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z"] Jul 09 04:58:37.667575 ip-10-0-142-255 kubenswrapper[2561]: W0709 04:58:37.667550 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bd5a49_7aad_4b7f_b39b_905d028d8797.slice/crio-ed3d1582a0323e96b1b180fcb5b37fbc9d324841534fa61ee3419de021e04ac0 WatchSource:0}: Error finding container ed3d1582a0323e96b1b180fcb5b37fbc9d324841534fa61ee3419de021e04ac0: Status 404 returned error can't find the container with id ed3d1582a0323e96b1b180fcb5b37fbc9d324841534fa61ee3419de021e04ac0 Jul 09 04:58:37.670062 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.670036 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:37.670131 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.670098 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:37.670131 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:37.670125 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 04:58:38.608683 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:38.608651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" event={"ID":"77bd5a49-7aad-4b7f-b39b-905d028d8797","Type":"ContainerStarted","Data":"b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e"} Jul 09 04:58:38.609095 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:38.608726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" event={"ID":"77bd5a49-7aad-4b7f-b39b-905d028d8797","Type":"ContainerStarted","Data":"ed3d1582a0323e96b1b180fcb5b37fbc9d324841534fa61ee3419de021e04ac0"} Jul 09 04:58:38.629782 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:38.629732 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" podStartSLOduration=1.629718064 podStartE2EDuration="1.629718064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:58:38.62803178 +0000 UTC m=+1599.777077359" watchObservedRunningTime="2026-07-09 04:58:38.629718064 +0000 UTC m=+1599.778763612" Jul 09 04:58:39.444662 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:39.444629 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60120d7a-9157-464e-9796-6e90b171640d" path="/var/lib/kubelet/pods/60120d7a-9157-464e-9796-6e90b171640d/volumes" Jul 09 04:58:39.526735 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:39.526710 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:39.531380 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:39.531361 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:39.614144 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:39.614110 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:39.615140 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:39.615123 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:42.947149 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:42.947120 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z"] Jul 09 04:58:42.947615 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:42.947301 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" podUID="77bd5a49-7aad-4b7f-b39b-905d028d8797" containerName="istio-proxy" containerID="cri-o://b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e" gracePeriod=30 Jul 09 04:58:49.397694 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.397665 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:49.444152 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444129 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-data\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444152 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444161 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr7hp\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-kube-api-access-fr7hp\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444197 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-certs\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444228 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-credential-socket\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444256 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-token\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444319 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-podinfo\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444347 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-socket\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444366 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444365 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-envoy\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444563 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444409 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bd5a49-7aad-4b7f-b39b-905d028d8797-istiod-ca-cert\") pod \"77bd5a49-7aad-4b7f-b39b-905d028d8797\" (UID: \"77bd5a49-7aad-4b7f-b39b-905d028d8797\") " Jul 09 04:58:49.444563 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444454 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:49.444699 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444683 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.444774 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444757 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77bd5a49-7aad-4b7f-b39b-905d028d8797-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:58:49.444972 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444952 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:49.445020 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.444972 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-data" (OuterVolumeSpecName: "istio-data") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:49.445550 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.445524 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:49.447158 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.447130 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-token" (OuterVolumeSpecName: "istio-token") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:58:49.447430 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.447402 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-kube-api-access-fr7hp" (OuterVolumeSpecName: "kube-api-access-fr7hp") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "kube-api-access-fr7hp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:58:49.447574 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.447554 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:58:49.447750 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.447732 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77bd5a49-7aad-4b7f-b39b-905d028d8797" (UID: "77bd5a49-7aad-4b7f-b39b-905d028d8797"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546116 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546137 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546148 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546156 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77bd5a49-7aad-4b7f-b39b-905d028d8797-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546164 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546175 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr7hp\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-kube-api-access-fr7hp\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546188 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77bd5a49-7aad-4b7f-b39b-905d028d8797-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.546204 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.546199 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77bd5a49-7aad-4b7f-b39b-905d028d8797-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 04:58:49.664105 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.664071 2561 generic.go:356] "Generic (PLEG): container finished" podID="77bd5a49-7aad-4b7f-b39b-905d028d8797" containerID="b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e" exitCode=0 Jul 09 04:58:49.664321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.664120 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" Jul 09 04:58:49.664321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.664156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" event={"ID":"77bd5a49-7aad-4b7f-b39b-905d028d8797","Type":"ContainerDied","Data":"b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e"} Jul 09 04:58:49.664321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.664209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z" event={"ID":"77bd5a49-7aad-4b7f-b39b-905d028d8797","Type":"ContainerDied","Data":"ed3d1582a0323e96b1b180fcb5b37fbc9d324841534fa61ee3419de021e04ac0"} Jul 09 04:58:49.664321 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.664231 2561 scope.go:117] "RemoveContainer" containerID="b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e" Jul 09 04:58:49.673108 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.673094 2561 scope.go:117] "RemoveContainer" containerID="b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e" Jul 09 04:58:49.673349 ip-10-0-142-255 kubenswrapper[2561]: E0709 04:58:49.673328 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e\": container with ID starting with b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e not found: ID does not exist" containerID="b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e" Jul 09 04:58:49.673419 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.673356 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e"} err="failed to get container status \"b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e\": rpc error: code = NotFound desc = could not find container \"b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e\": container with ID starting with b4e6caf92d4f0f60498b90642db5af519a39f11ed19f69733358070b1a38697e not found: ID does not exist" Jul 09 04:58:49.686798 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.686777 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z"] Jul 09 04:58:49.690928 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:49.690906 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-610b04b1-openshift-default-f598b5f55-8f94z"] Jul 09 04:58:51.443340 ip-10-0-142-255 kubenswrapper[2561]: I0709 04:58:51.443240 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77bd5a49-7aad-4b7f-b39b-905d028d8797" path="/var/lib/kubelet/pods/77bd5a49-7aad-4b7f-b39b-905d028d8797/volumes" Jul 09 05:00:12.720724 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:12.720687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:00:23.364525 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.364444 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv"] Jul 09 05:00:23.365033 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.365000 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bd5a49-7aad-4b7f-b39b-905d028d8797" containerName="istio-proxy" Jul 09 05:00:23.365033 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.365024 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bd5a49-7aad-4b7f-b39b-905d028d8797" containerName="istio-proxy" Jul 09 05:00:23.365181 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.365048 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" Jul 09 05:00:23.365181 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.365058 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="60120d7a-9157-464e-9796-6e90b171640d" containerName="istio-proxy" Jul 09 05:00:23.365181 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.365148 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bd5a49-7aad-4b7f-b39b-905d028d8797" containerName="istio-proxy" Jul 09 05:00:23.368369 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.368351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.370753 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.370736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ae534da9-openshift-default-dockercfg-6lrvb\"" Jul 09 05:00:23.378671 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.378651 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv"] Jul 09 05:00:23.516952 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.516922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-credential-socket\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517120 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.516957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-socket\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517120 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.516991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xmw\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-kube-api-access-42xmw\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517120 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.517099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-envoy\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517256 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.517149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7667a862-de16-4681-9a81-eb1df5712220-istio-podinfo\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517256 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.517183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-certs\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517256 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.517204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-data\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517256 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.517224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-istio-token\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.517256 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.517239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7667a862-de16-4681-9a81-eb1df5712220-istiod-ca-cert\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.617718 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617688 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-credential-socket\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.617858 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-socket\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.617858 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xmw\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-kube-api-access-42xmw\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.617858 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-envoy\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7667a862-de16-4681-9a81-eb1df5712220-istio-podinfo\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-certs\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-data\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617946 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-istio-token\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.617968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7667a862-de16-4681-9a81-eb1df5712220-istiod-ca-cert\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618301 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.618109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-socket\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618301 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.618159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-credential-socket\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618414 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.618325 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-data\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618414 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.618347 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-certs\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.618604 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.618587 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7667a862-de16-4681-9a81-eb1df5712220-istiod-ca-cert\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.620333 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.620307 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-envoy\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.620435 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.620352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7667a862-de16-4681-9a81-eb1df5712220-istio-podinfo\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.626451 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.626419 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-istio-token\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.626700 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.626683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xmw\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-kube-api-access-42xmw\") pod \"e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.679124 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.679100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:23.810417 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.810392 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv"] Jul 09 05:00:23.812918 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:00:23.812887 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7667a862_de16_4681_9a81_eb1df5712220.slice/crio-961f89b5cca3cecc4e7c75d410ea7715294f273b2dc9f8fb6d3bbd6d6e677062 WatchSource:0}: Error finding container 961f89b5cca3cecc4e7c75d410ea7715294f273b2dc9f8fb6d3bbd6d6e677062: Status 404 returned error can't find the container with id 961f89b5cca3cecc4e7c75d410ea7715294f273b2dc9f8fb6d3bbd6d6e677062 Jul 09 05:00:23.815008 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.814970 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:00:23.815101 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.815052 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:00:23.815101 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:23.815091 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:00:24.101818 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:24.101781 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" event={"ID":"7667a862-de16-4681-9a81-eb1df5712220","Type":"ContainerStarted","Data":"43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2"} Jul 09 05:00:24.102009 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:24.101835 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" event={"ID":"7667a862-de16-4681-9a81-eb1df5712220","Type":"ContainerStarted","Data":"961f89b5cca3cecc4e7c75d410ea7715294f273b2dc9f8fb6d3bbd6d6e677062"} Jul 09 05:00:24.122196 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:24.122104 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" podStartSLOduration=1.122087822 podStartE2EDuration="1.122087822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:00:24.120190739 +0000 UTC m=+1705.269236308" watchObservedRunningTime="2026-07-09 05:00:24.122087822 +0000 UTC m=+1705.271133393" Jul 09 05:00:24.680141 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:24.680111 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:24.684810 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:24.684790 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:25.107393 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:25.107315 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:25.108341 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:25.108324 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:25.223791 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:25.223755 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:00:35.917969 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:35.917928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:00:40.109485 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.109450 2561 patch_prober.go:28] interesting pod/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 05:00:40.109913 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.109506 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 05:00:40.180163 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.180131 2561 generic.go:356] "Generic (PLEG): container finished" podID="7667a862-de16-4681-9a81-eb1df5712220" containerID="43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2" exitCode=0 Jul 09 05:00:40.180371 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.180185 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" event={"ID":"7667a862-de16-4681-9a81-eb1df5712220","Type":"ContainerDied","Data":"43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2"} Jul 09 05:00:40.180581 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.180565 2561 scope.go:117] "RemoveContainer" containerID="43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2" Jul 09 05:00:40.181566 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.181536 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:00:40.181641 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.181625 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:00:40.181687 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:40.181672 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:00:41.187115 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:41.187081 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" event={"ID":"7667a862-de16-4681-9a81-eb1df5712220","Type":"ContainerStarted","Data":"ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa"} Jul 09 05:00:41.679523 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:41.679482 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:41.683350 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:41.683328 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:42.192100 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:42.192073 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:42.193057 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:42.193036 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:44.058561 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:44.058529 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv"] Jul 09 05:00:44.201338 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:44.201304 2561 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" secret="" err="secret \"e2e-mt-ae534da9-openshift-default-dockercfg-6lrvb\" not found" Jul 09 05:00:44.434036 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:44.434001 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:00:45.205802 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:45.205733 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" containerID="cri-o://ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa" gracePeriod=30 Jul 09 05:00:50.464497 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.464474 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:50.558410 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558325 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-envoy\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558410 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558374 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-credential-socket\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558639 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558451 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-data\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558639 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558491 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xmw\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-kube-api-access-42xmw\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558639 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558514 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7667a862-de16-4681-9a81-eb1df5712220-istio-podinfo\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558639 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558542 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-istio-token\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558639 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558589 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-socket\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558639 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558622 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-certs\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558922 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558661 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7667a862-de16-4681-9a81-eb1df5712220-istiod-ca-cert\") pod \"7667a862-de16-4681-9a81-eb1df5712220\" (UID: \"7667a862-de16-4681-9a81-eb1df5712220\") " Jul 09 05:00:50.558922 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558682 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:00:50.558922 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558871 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:00:50.558922 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.558898 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:00:50.559131 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.559006 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.559131 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.559028 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.559131 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.559081 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.559281 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.559195 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7667a862-de16-4681-9a81-eb1df5712220-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 05:00:50.559613 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.559588 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-data" (OuterVolumeSpecName: "istio-data") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:00:50.560824 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.560805 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7667a862-de16-4681-9a81-eb1df5712220-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 05:00:50.560894 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.560835 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-kube-api-access-42xmw" (OuterVolumeSpecName: "kube-api-access-42xmw") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "kube-api-access-42xmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:00:50.561023 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.561003 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:00:50.561070 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.561012 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-istio-token" (OuterVolumeSpecName: "istio-token") pod "7667a862-de16-4681-9a81-eb1df5712220" (UID: "7667a862-de16-4681-9a81-eb1df5712220"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:00:50.660558 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.660521 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7667a862-de16-4681-9a81-eb1df5712220-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.660558 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.660551 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.660558 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.660559 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7667a862-de16-4681-9a81-eb1df5712220-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.660558 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.660567 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xmw\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-kube-api-access-42xmw\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.660824 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.660577 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7667a862-de16-4681-9a81-eb1df5712220-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:50.660824 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:50.660586 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7667a862-de16-4681-9a81-eb1df5712220-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:00:51.234788 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.234755 2561 generic.go:356] "Generic (PLEG): container finished" podID="7667a862-de16-4681-9a81-eb1df5712220" containerID="ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa" exitCode=0 Jul 09 05:00:51.234980 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.234803 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" Jul 09 05:00:51.234980 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.234843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" event={"ID":"7667a862-de16-4681-9a81-eb1df5712220","Type":"ContainerDied","Data":"ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa"} Jul 09 05:00:51.234980 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.234897 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv" event={"ID":"7667a862-de16-4681-9a81-eb1df5712220","Type":"ContainerDied","Data":"961f89b5cca3cecc4e7c75d410ea7715294f273b2dc9f8fb6d3bbd6d6e677062"} Jul 09 05:00:51.234980 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.234918 2561 scope.go:117] "RemoveContainer" containerID="ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa" Jul 09 05:00:51.244258 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.244241 2561 scope.go:117] "RemoveContainer" containerID="43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2" Jul 09 05:00:51.252060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.252043 2561 scope.go:117] "RemoveContainer" containerID="ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa" Jul 09 05:00:51.252324 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:00:51.252307 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa\": container with ID starting with ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa not found: ID does not exist" containerID="ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa" Jul 09 05:00:51.252408 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.252341 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa"} err="failed to get container status \"ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa\": rpc error: code = NotFound desc = could not find container \"ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa\": container with ID starting with ecc0efa14cff7272f3f318f2e9122e5afee245fa53f4b67a7c098eb75f6136aa not found: ID does not exist" Jul 09 05:00:51.252408 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.252365 2561 scope.go:117] "RemoveContainer" containerID="43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2" Jul 09 05:00:51.252607 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:00:51.252582 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2\": container with ID starting with 43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2 not found: ID does not exist" containerID="43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2" Jul 09 05:00:51.252657 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.252614 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2"} err="failed to get container status \"43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2\": rpc error: code = NotFound desc = could not find container \"43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2\": container with ID starting with 43ec29ae634a919313b8923ec236b07f5605e9fe0ad128f935f6c3dbb2a1c0e2 not found: ID does not exist" Jul 09 05:00:51.257440 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.257417 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv"] Jul 09 05:00:51.262476 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.262458 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ae534da9-openshift-default-77bc898dc-48dpv"] Jul 09 05:00:51.443024 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:00:51.442993 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7667a862-de16-4681-9a81-eb1df5712220" path="/var/lib/kubelet/pods/7667a862-de16-4681-9a81-eb1df5712220/volumes" Jul 09 05:01:03.090010 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.089979 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p"] Jul 09 05:01:03.090383 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.090369 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" Jul 09 05:01:03.090383 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.090381 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" Jul 09 05:01:03.090463 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.090397 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" Jul 09 05:01:03.090463 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.090403 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" Jul 09 05:01:03.090536 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.090467 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" Jul 09 05:01:03.090536 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.090479 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7667a862-de16-4681-9a81-eb1df5712220" containerName="istio-proxy" Jul 09 05:01:03.093333 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.093318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.095507 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.095477 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8146f0d0-openshift-default-dockercfg-mvzmz\"" Jul 09 05:01:03.106598 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.106576 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p"] Jul 09 05:01:03.167173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istiod-ca-cert\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167339 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-socket\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167339 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-data\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167339 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-envoy\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167339 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9whc\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-kube-api-access-d9whc\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167339 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-credential-socket\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-podinfo\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-token\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.167520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.167482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-certs\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268112 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-socket\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268315 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-data\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268315 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-envoy\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268315 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9whc\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-kube-api-access-d9whc\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268315 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-credential-socket\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268315 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-podinfo\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268593 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-token\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268593 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-certs\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268593 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istiod-ca-cert\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268593 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-socket\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268593 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-data\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268859 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268773 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-certs\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.268972 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.268953 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-credential-socket\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.269098 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.269081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istiod-ca-cert\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.270495 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.270477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-envoy\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.270793 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.270774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-podinfo\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.276860 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.276840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-token\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.277001 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.276985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9whc\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-kube-api-access-d9whc\") pod \"e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.402946 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.402924 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:03.534853 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.534831 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p"] Jul 09 05:01:03.537043 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:01:03.537021 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92b1829_5cbc_44c2_8aee_695f62b2faf2.slice/crio-ecc6703a515eeb80d44c0e486f5f1cedc8ed724292b700ca6ad9622ba1dfb1e5 WatchSource:0}: Error finding container ecc6703a515eeb80d44c0e486f5f1cedc8ed724292b700ca6ad9622ba1dfb1e5: Status 404 returned error can't find the container with id ecc6703a515eeb80d44c0e486f5f1cedc8ed724292b700ca6ad9622ba1dfb1e5 Jul 09 05:01:03.539340 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.539307 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:01:03.539449 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.539391 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:01:03.539509 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:03.539444 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:01:04.294442 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:04.294393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" event={"ID":"b92b1829-5cbc-44c2-8aee-695f62b2faf2","Type":"ContainerStarted","Data":"da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241"} Jul 09 05:01:04.294789 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:04.294527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" event={"ID":"b92b1829-5cbc-44c2-8aee-695f62b2faf2","Type":"ContainerStarted","Data":"ecc6703a515eeb80d44c0e486f5f1cedc8ed724292b700ca6ad9622ba1dfb1e5"} Jul 09 05:01:04.314939 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:04.314896 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podStartSLOduration=1.314884007 podStartE2EDuration="1.314884007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:01:04.312210294 +0000 UTC m=+1745.461255863" watchObservedRunningTime="2026-07-09 05:01:04.314884007 +0000 UTC m=+1745.463929577" Jul 09 05:01:04.403422 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:04.403399 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:04.408138 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:04.408116 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:05.300039 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:05.300008 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:05.300876 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:05.300861 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:12.222309 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:12.222260 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:01:20.301649 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.301559 2561 patch_prober.go:28] interesting pod/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 09 05:01:20.301649 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.301613 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 09 05:01:20.370577 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.370552 2561 generic.go:356] "Generic (PLEG): container finished" podID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerID="da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241" exitCode=0 Jul 09 05:01:20.370710 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.370598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" event={"ID":"b92b1829-5cbc-44c2-8aee-695f62b2faf2","Type":"ContainerDied","Data":"da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241"} Jul 09 05:01:20.370927 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.370915 2561 scope.go:117] "RemoveContainer" containerID="da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241" Jul 09 05:01:20.371810 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.371784 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:01:20.371876 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.371846 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:01:20.371917 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:20.371886 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:01:21.376937 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:21.376905 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" event={"ID":"b92b1829-5cbc-44c2-8aee-695f62b2faf2","Type":"ContainerStarted","Data":"29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528"} Jul 09 05:01:21.403798 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:21.403762 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:21.404201 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:21.404011 2561 patch_prober.go:28] interesting pod/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 09 05:01:21.404201 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:21.404046 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 09 05:01:22.408489 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:22.408452 2561 patch_prober.go:28] interesting pod/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 09 05:01:22.408951 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:22.408515 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 09 05:01:23.403841 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:23.403806 2561 patch_prober.go:28] interesting pod/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 09 05:01:23.404020 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:23.403889 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 09 05:01:24.403838 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:24.403802 2561 patch_prober.go:28] interesting pod/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jul 09 05:01:24.404221 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:24.403855 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jul 09 05:01:25.407444 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:25.407416 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:25.407894 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:25.407875 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:25.408513 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:25.408493 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:01:25.529655 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:25.529616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:01:45.720768 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:45.720734 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:01:59.503621 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:59.503595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 05:01:59.506971 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:01:59.506948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 05:02:00.028561 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:00.028524 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:02:38.722391 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:38.722363 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:02:42.397784 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:42.397752 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p"] Jul 09 05:02:42.398173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:42.397947 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" containerID="cri-o://29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528" gracePeriod=30 Jul 09 05:02:47.655555 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.655530 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:02:47.782615 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782511 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-token\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782615 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782573 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9whc\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-kube-api-access-d9whc\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782615 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782601 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-credential-socket\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782641 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-certs\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782668 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-podinfo\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782694 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istiod-ca-cert\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782746 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-data\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-socket\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.782892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782849 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-envoy\") pod \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\" (UID: \"b92b1829-5cbc-44c2-8aee-695f62b2faf2\") " Jul 09 05:02:47.783191 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.782986 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:02:47.783191 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.783146 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 05:02:47.783333 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.783201 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.783506 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.783448 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:02:47.783641 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.783558 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:02:47.783798 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.783763 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-data" (OuterVolumeSpecName: "istio-data") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:02:47.784926 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.784903 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-token" (OuterVolumeSpecName: "istio-token") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:02:47.784926 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.784901 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 05:02:47.785061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.784947 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-kube-api-access-d9whc" (OuterVolumeSpecName: "kube-api-access-d9whc") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "kube-api-access-d9whc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:02:47.785061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.784968 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b92b1829-5cbc-44c2-8aee-695f62b2faf2" (UID: "b92b1829-5cbc-44c2-8aee-695f62b2faf2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:02:47.792814 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.792783 2561 generic.go:356] "Generic (PLEG): container finished" podID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerID="29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528" exitCode=0 Jul 09 05:02:47.792915 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.792828 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" Jul 09 05:02:47.792915 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.792859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" event={"ID":"b92b1829-5cbc-44c2-8aee-695f62b2faf2","Type":"ContainerDied","Data":"29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528"} Jul 09 05:02:47.792988 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.792938 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p" event={"ID":"b92b1829-5cbc-44c2-8aee-695f62b2faf2","Type":"ContainerDied","Data":"ecc6703a515eeb80d44c0e486f5f1cedc8ed724292b700ca6ad9622ba1dfb1e5"} Jul 09 05:02:47.792988 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.792961 2561 scope.go:117] "RemoveContainer" containerID="29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528" Jul 09 05:02:47.805032 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.805015 2561 scope.go:117] "RemoveContainer" containerID="da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241" Jul 09 05:02:47.813127 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.813085 2561 scope.go:117] "RemoveContainer" containerID="29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528" Jul 09 05:02:47.813461 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:02:47.813437 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528\": container with ID starting with 29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528 not found: ID does not exist" containerID="29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528" Jul 09 05:02:47.813553 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.813471 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528"} err="failed to get container status \"29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528\": rpc error: code = NotFound desc = could not find container \"29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528\": container with ID starting with 29f7bd7387b73cbd28df37dcd41acab081f786a8d90f3067a678ab9afa00d528 not found: ID does not exist" Jul 09 05:02:47.813553 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.813492 2561 scope.go:117] "RemoveContainer" containerID="da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241" Jul 09 05:02:47.814139 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:02:47.814107 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241\": container with ID starting with da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241 not found: ID does not exist" containerID="da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241" Jul 09 05:02:47.814218 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.814146 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241"} err="failed to get container status \"da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241\": rpc error: code = NotFound desc = could not find container \"da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241\": container with ID starting with da6bba9fae8d3c1144ba61f4adf2042eb3a5ff30f888a8fec35256219896a241 not found: ID does not exist" Jul 09 05:02:47.816354 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.816332 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p"] Jul 09 05:02:47.817981 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.817964 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8146f0d0-openshift-default-7bbf66d97f-ppx8p"] Jul 09 05:02:47.884121 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884091 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884121 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884119 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884121 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884130 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884379 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884139 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9whc\" (UniqueName: \"kubernetes.io/projected/b92b1829-5cbc-44c2-8aee-695f62b2faf2-kube-api-access-d9whc\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884379 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884150 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884379 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884160 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884379 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884168 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:47.884379 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:47.884175 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b92b1829-5cbc-44c2-8aee-695f62b2faf2-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:02:49.218711 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:49.218678 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:02:49.443735 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:02:49.443695 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" path="/var/lib/kubelet/pods/b92b1829-5cbc-44c2-8aee-695f62b2faf2/volumes" Jul 09 05:03:00.225344 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:00.225309 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:03:36.650830 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.650756 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c"] Jul 09 05:03:36.651251 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.651127 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" Jul 09 05:03:36.651251 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.651139 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" Jul 09 05:03:36.651251 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.651162 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" Jul 09 05:03:36.651251 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.651167 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" Jul 09 05:03:36.651251 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.651238 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" Jul 09 05:03:36.654270 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.654254 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.656646 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.656630 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-61a9e8-openshift-default-dockercfg-bz6mj\"" Jul 09 05:03:36.665867 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.665845 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c"] Jul 09 05:03:36.702294 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95pkw\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-kube-api-access-95pkw\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702407 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-credential-socket\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702407 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-certs\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702407 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-socket\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702515 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-token\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702515 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-podinfo\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702515 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702475 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istiod-ca-cert\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702607 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-data\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.702607 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.702594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-envoy\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.803816 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.803785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istiod-ca-cert\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.803816 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.803825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-data\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804086 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.803954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-envoy\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804086 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95pkw\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-kube-api-access-95pkw\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804086 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-credential-socket\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804086 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-certs\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804304 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-socket\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804304 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-token\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804304 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-podinfo\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804463 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-data\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804463 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-credential-socket\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804575 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-certs\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804652 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804629 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istiod-ca-cert\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.804652 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.804641 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-socket\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.806369 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.806350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-envoy\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.806614 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.806598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-podinfo\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.811168 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.811147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-token\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.811397 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.811376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95pkw\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-kube-api-access-95pkw\") pod \"e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:36.964913 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:36.964843 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:37.102383 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:37.102360 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c"] Jul 09 05:03:37.104686 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:03:37.104651 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c11877d_b82d_4e80_b1a8_3f12b866f7cd.slice/crio-28b59cde55f3c9aebf27fe535de2e1b9be23d055c2497cc75287afa86166e21f WatchSource:0}: Error finding container 28b59cde55f3c9aebf27fe535de2e1b9be23d055c2497cc75287afa86166e21f: Status 404 returned error can't find the container with id 28b59cde55f3c9aebf27fe535de2e1b9be23d055c2497cc75287afa86166e21f Jul 09 05:03:37.106878 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:37.106840 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:03:37.106957 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:37.106922 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:03:37.106996 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:37.106961 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:03:38.023386 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:38.023351 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" event={"ID":"0c11877d-b82d-4e80-b1a8-3f12b866f7cd","Type":"ContainerStarted","Data":"a445302b7f0d7df8f58d65b289fa1af05d580e255545296916c55bdc07a1a145"} Jul 09 05:03:38.023868 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:38.023409 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" event={"ID":"0c11877d-b82d-4e80-b1a8-3f12b866f7cd","Type":"ContainerStarted","Data":"28b59cde55f3c9aebf27fe535de2e1b9be23d055c2497cc75287afa86166e21f"} Jul 09 05:03:38.043501 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:38.043455 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podStartSLOduration=2.043440612 podStartE2EDuration="2.043440612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:03:38.041622423 +0000 UTC m=+1899.190667994" watchObservedRunningTime="2026-07-09 05:03:38.043440612 +0000 UTC m=+1899.192486181" Jul 09 05:03:38.965966 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:38.965932 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:38.970731 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:38.970706 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:39.027644 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:39.027613 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:39.028394 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:39.028379 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:45.917823 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:45.917789 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:03:54.028920 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.028842 2561 patch_prober.go:28] interesting pod/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 09 05:03:54.028920 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.028896 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 09 05:03:54.097658 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.097621 2561 generic.go:356] "Generic (PLEG): container finished" podID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerID="a445302b7f0d7df8f58d65b289fa1af05d580e255545296916c55bdc07a1a145" exitCode=0 Jul 09 05:03:54.097814 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.097693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" event={"ID":"0c11877d-b82d-4e80-b1a8-3f12b866f7cd","Type":"ContainerDied","Data":"a445302b7f0d7df8f58d65b289fa1af05d580e255545296916c55bdc07a1a145"} Jul 09 05:03:54.098086 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.098071 2561 scope.go:117] "RemoveContainer" containerID="a445302b7f0d7df8f58d65b289fa1af05d580e255545296916c55bdc07a1a145" Jul 09 05:03:54.099060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.099032 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:03:54.099148 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.099117 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:03:54.099221 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:54.099164 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:03:55.106035 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:55.105999 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" event={"ID":"0c11877d-b82d-4e80-b1a8-3f12b866f7cd","Type":"ContainerStarted","Data":"731b0ef938a39fdceac3070e053c1b8086517c42c3cb6f85f808d283af4ebbe7"} Jul 09 05:03:55.965700 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:55.965666 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:55.965892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:55.965821 2561 patch_prober.go:28] interesting pod/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 09 05:03:55.965892 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:55.965872 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 09 05:03:56.965856 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:56.965821 2561 patch_prober.go:28] interesting pod/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 09 05:03:56.966344 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:56.965899 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 09 05:03:57.925120 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:57.925091 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:03:57.965668 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:57.965628 2561 patch_prober.go:28] interesting pod/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 09 05:03:57.965837 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:57.965686 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 09 05:03:58.965495 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:58.965459 2561 patch_prober.go:28] interesting pod/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 09 05:03:58.965946 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:58.965516 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 09 05:03:59.969566 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:59.969537 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:59.970009 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:59.969809 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:03:59.970615 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:03:59.970601 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:04:09.616406 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:09.616373 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:04:20.920763 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:20.920733 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:04:41.855687 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.855658 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn"] Jul 09 05:04:41.856117 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.856055 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92b1829-5cbc-44c2-8aee-695f62b2faf2" containerName="istio-proxy" Jul 09 05:04:41.859107 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.859087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:41.862469 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.862440 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-64ed88\"/\"default-dockercfg-lhg4p\"" Jul 09 05:04:41.862469 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.862467 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-64ed88\"/\"kube-root-ca.crt\"" Jul 09 05:04:41.862671 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.862472 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-64ed88\"/\"test-model-64ed88-kserve-self-signed-certs\"" Jul 09 05:04:41.862671 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.862441 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-64ed88\"/\"openshift-service-ca.crt\"" Jul 09 05:04:41.866011 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.865990 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn"] Jul 09 05:04:41.979033 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.979010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-dshm\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:41.979177 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.979038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tls-certs\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:41.979177 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.979071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-home\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:41.979278 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.979181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82k7f\" (UniqueName: \"kubernetes.io/projected/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-kube-api-access-82k7f\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:41.979278 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.979238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tmp-dir\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:41.979278 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:41.979276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-model-cache\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080216 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-model-cache\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080397 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-dshm\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080397 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tls-certs\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080397 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-home\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080569 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82k7f\" (UniqueName: \"kubernetes.io/projected/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-kube-api-access-82k7f\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080569 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tmp-dir\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080675 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080596 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-model-cache\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080733 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080714 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-home\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.080833 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.080814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tmp-dir\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.082645 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.082628 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-dshm\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.082940 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.082922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tls-certs\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.087806 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.087788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82k7f\" (UniqueName: \"kubernetes.io/projected/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-kube-api-access-82k7f\") pod \"test-model-64ed88-kserve-564fcc67f5-vthdn\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.169105 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.169070 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:42.304003 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.303981 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn"] Jul 09 05:04:42.306437 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:04:42.306410 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67c8f6b1_3f32_40c9_8289_b0c32fe82d6d.slice/crio-68202871a42eb931731f9594a26d8f671e1aac7db496158d33f1b91ad0007823 WatchSource:0}: Error finding container 68202871a42eb931731f9594a26d8f671e1aac7db496158d33f1b91ad0007823: Status 404 returned error can't find the container with id 68202871a42eb931731f9594a26d8f671e1aac7db496158d33f1b91ad0007823 Jul 09 05:04:42.325243 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:42.325211 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" event={"ID":"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d","Type":"ContainerStarted","Data":"68202871a42eb931731f9594a26d8f671e1aac7db496158d33f1b91ad0007823"} Jul 09 05:04:43.331133 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:43.331095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" event={"ID":"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d","Type":"ContainerStarted","Data":"18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba"} Jul 09 05:04:43.346385 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:43.346339 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" podStartSLOduration=2.346322661 podStartE2EDuration="2.346322661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:04:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:04:43.345443129 +0000 UTC m=+1964.494488712" watchObservedRunningTime="2026-07-09 05:04:43.346322661 +0000 UTC m=+1964.495368208" Jul 09 05:04:46.219599 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:46.219566 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:04:52.170087 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:52.169996 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:52.170087 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:52.170062 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:52.182714 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:52.182692 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:52.381660 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:52.381622 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:04:59.587016 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:04:59.586986 2561 scope.go:117] "RemoveContainer" containerID="51b3bc62dc71b2951f49f5a916bb8ea909dfbfad0944049ce34b00f5c15ec1ae" Jul 09 05:05:00.725704 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:00.725672 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:05:07.732721 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:07.732686 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn"] Jul 09 05:05:13.824301 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:13.824250 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:05:22.752820 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:22.752759 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" podUID="67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" containerName="main" containerID="cri-o://18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba" gracePeriod=45 Jul 09 05:05:22.993270 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:22.993248 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:05:23.119522 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119499 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-dshm\") pod \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " Jul 09 05:05:23.119645 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119549 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tmp-dir\") pod \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " Jul 09 05:05:23.119645 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119590 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tls-certs\") pod \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " Jul 09 05:05:23.119645 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119611 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-home\") pod \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " Jul 09 05:05:23.119792 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119650 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-model-cache\") pod \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " Jul 09 05:05:23.119848 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119831 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82k7f\" (UniqueName: \"kubernetes.io/projected/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-kube-api-access-82k7f\") pod \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\" (UID: \"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d\") " Jul 09 05:05:23.119906 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119850 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" (UID: "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:23.119906 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119871 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" (UID: "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:23.119998 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.119931 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-home" (OuterVolumeSpecName: "home") pod "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" (UID: "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:23.120137 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.120116 2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tmp-dir\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:23.120200 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.120138 2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-home\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:23.120200 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.120147 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-model-cache\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:23.121805 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.121779 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-dshm" (OuterVolumeSpecName: "dshm") pod "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" (UID: "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:23.121908 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.121874 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" (UID: "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 05:05:23.121908 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.121895 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-kube-api-access-82k7f" (OuterVolumeSpecName: "kube-api-access-82k7f") pod "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" (UID: "67c8f6b1-3f32-40c9-8289-b0c32fe82d6d"). InnerVolumeSpecName "kube-api-access-82k7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:05:23.221515 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.221488 2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-dshm\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:23.221515 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.221510 2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-tls-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:23.221515 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.221521 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82k7f\" (UniqueName: \"kubernetes.io/projected/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d-kube-api-access-82k7f\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:23.512949 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.512920 2561 generic.go:356] "Generic (PLEG): container finished" podID="67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" containerID="18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba" exitCode=0 Jul 09 05:05:23.513081 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.512955 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" Jul 09 05:05:23.513081 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.513000 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" event={"ID":"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d","Type":"ContainerDied","Data":"18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba"} Jul 09 05:05:23.513081 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.513037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn" event={"ID":"67c8f6b1-3f32-40c9-8289-b0c32fe82d6d","Type":"ContainerDied","Data":"68202871a42eb931731f9594a26d8f671e1aac7db496158d33f1b91ad0007823"} Jul 09 05:05:23.513081 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.513057 2561 scope.go:117] "RemoveContainer" containerID="18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba" Jul 09 05:05:23.521321 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.521305 2561 scope.go:117] "RemoveContainer" containerID="18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba" Jul 09 05:05:23.521557 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:05:23.521538 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba\": container with ID starting with 18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba not found: ID does not exist" containerID="18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba" Jul 09 05:05:23.521601 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.521564 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba"} err="failed to get container status \"18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba\": rpc error: code = NotFound desc = could not find container \"18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba\": container with ID starting with 18de94bd896ae446f18d99f6b7156caddfe296bb1eacd7e92cfffa772a0ef9ba not found: ID does not exist" Jul 09 05:05:23.528983 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.528964 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn"] Jul 09 05:05:23.532171 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:23.532151 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-64ed88/test-model-64ed88-kserve-564fcc67f5-vthdn"] Jul 09 05:05:25.443110 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:25.443077 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" path="/var/lib/kubelet/pods/67c8f6b1-3f32-40c9-8289-b0c32fe82d6d/volumes" Jul 09 05:05:50.452899 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:50.452858 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c"] Jul 09 05:05:50.453269 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:50.453171 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" containerID="cri-o://731b0ef938a39fdceac3070e053c1b8086517c42c3cb6f85f808d283af4ebbe7" gracePeriod=30 Jul 09 05:05:54.722517 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:54.722485 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:05:55.663173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.663139 2561 generic.go:356] "Generic (PLEG): container finished" podID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerID="731b0ef938a39fdceac3070e053c1b8086517c42c3cb6f85f808d283af4ebbe7" exitCode=0 Jul 09 05:05:55.663317 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.663201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" event={"ID":"0c11877d-b82d-4e80-b1a8-3f12b866f7cd","Type":"ContainerDied","Data":"731b0ef938a39fdceac3070e053c1b8086517c42c3cb6f85f808d283af4ebbe7"} Jul 09 05:05:55.663317 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.663258 2561 scope.go:117] "RemoveContainer" containerID="a445302b7f0d7df8f58d65b289fa1af05d580e255545296916c55bdc07a1a145" Jul 09 05:05:55.709785 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.709767 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:05:55.794045 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.793974 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-certs\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794045 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794026 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-envoy\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794052 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-socket\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794107 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-token\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794137 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istiod-ca-cert\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794167 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-data\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794190 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794195 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95pkw\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-kube-api-access-95pkw\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794255 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-credential-socket\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794520 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794275 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-podinfo\") pod \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\" (UID: \"0c11877d-b82d-4e80-b1a8-3f12b866f7cd\") " Jul 09 05:05:55.794946 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794567 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 05:05:55.794946 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794606 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.794946 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794634 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:55.794946 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.794644 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:55.795269 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.795241 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:55.796314 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.796277 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:05:55.796455 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.796435 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:05:55.796514 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.796442 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-kube-api-access-95pkw" (OuterVolumeSpecName: "kube-api-access-95pkw") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "kube-api-access-95pkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:05:55.796569 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.796534 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c11877d-b82d-4e80-b1a8-3f12b866f7cd" (UID: "0c11877d-b82d-4e80-b1a8-3f12b866f7cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 05:05:55.895907 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895881 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.895907 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895903 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.896061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895916 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95pkw\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-kube-api-access-95pkw\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.896061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895928 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.896061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895942 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.896061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895954 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.896061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895964 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:55.896061 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:55.895975 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c11877d-b82d-4e80-b1a8-3f12b866f7cd-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:05:56.675862 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:56.675814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" event={"ID":"0c11877d-b82d-4e80-b1a8-3f12b866f7cd","Type":"ContainerDied","Data":"28b59cde55f3c9aebf27fe535de2e1b9be23d055c2497cc75287afa86166e21f"} Jul 09 05:05:56.675862 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:56.675832 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c" Jul 09 05:05:56.676112 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:56.675905 2561 scope.go:117] "RemoveContainer" containerID="731b0ef938a39fdceac3070e053c1b8086517c42c3cb6f85f808d283af4ebbe7" Jul 09 05:05:56.696604 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:56.696578 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c"] Jul 09 05:05:56.699910 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:56.699890 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-61a9e8-openshift-default-59997c6cc-xfg9c"] Jul 09 05:05:57.443033 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:57.443001 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" path="/var/lib/kubelet/pods/0c11877d-b82d-4e80-b1a8-3f12b866f7cd/volumes" Jul 09 05:05:58.329606 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.329572 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd"] Jul 09 05:05:58.329952 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.329938 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" Jul 09 05:05:58.329994 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.329954 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" Jul 09 05:05:58.329994 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.329967 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" containerName="main" Jul 09 05:05:58.329994 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.329973 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" containerName="main" Jul 09 05:05:58.330087 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.330041 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" Jul 09 05:05:58.330087 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.330054 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c8f6b1-3f32-40c9-8289-b0c32fe82d6d" containerName="main" Jul 09 05:05:58.334686 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.334669 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.336792 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.336774 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ad2943-openshift-default-dockercfg-vfll2\"" Jul 09 05:05:58.343555 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.343535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd"] Jul 09 05:05:58.414592 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-envoy\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.414793 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-data\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.414793 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs74j\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-kube-api-access-vs74j\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.414793 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-socket\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.414793 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0099f13-0500-4738-b2bb-5daf9cfb37de-istiod-ca-cert\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.415007 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-certs\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.415007 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-credential-socket\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.415007 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414868 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-podinfo\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.415007 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.414915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-token\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.515828 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.515795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-token\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.515828 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.515833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-envoy\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.515864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-data\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.515920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs74j\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-kube-api-access-vs74j\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.515975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-socket\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0099f13-0500-4738-b2bb-5daf9cfb37de-istiod-ca-cert\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-certs\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516085 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-credential-socket\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-podinfo\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516404 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516388 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-data\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516768 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-credential-socket\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516768 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-certs\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.516849 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.516822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-socket\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.517050 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.517032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0099f13-0500-4738-b2bb-5daf9cfb37de-istiod-ca-cert\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.518352 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.518332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-envoy\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.518559 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.518541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-podinfo\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.523238 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.523215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-token\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.523468 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.523446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs74j\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-kube-api-access-vs74j\") pod \"e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.646231 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.646198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:05:58.783911 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.783890 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd"] Jul 09 05:05:58.786047 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:05:58.786018 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0099f13_0500_4738_b2bb_5daf9cfb37de.slice/crio-80cc2f4aa1eee791909ccae1f11a49ffe306ec32714cb59f00ca0ae787f20569 WatchSource:0}: Error finding container 80cc2f4aa1eee791909ccae1f11a49ffe306ec32714cb59f00ca0ae787f20569: Status 404 returned error can't find the container with id 80cc2f4aa1eee791909ccae1f11a49ffe306ec32714cb59f00ca0ae787f20569 Jul 09 05:05:58.788482 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.788452 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:05:58.788569 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.788511 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:05:58.788569 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:58.788534 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:05:59.691526 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:59.691483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" event={"ID":"d0099f13-0500-4738-b2bb-5daf9cfb37de","Type":"ContainerStarted","Data":"88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0"} Jul 09 05:05:59.691957 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:59.691564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" event={"ID":"d0099f13-0500-4738-b2bb-5daf9cfb37de","Type":"ContainerStarted","Data":"80cc2f4aa1eee791909ccae1f11a49ffe306ec32714cb59f00ca0ae787f20569"} Jul 09 05:05:59.713539 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:05:59.713492 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" podStartSLOduration=1.713476775 podStartE2EDuration="1.713476775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:05:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:05:59.711035109 +0000 UTC m=+2040.860080677" watchObservedRunningTime="2026-07-09 05:05:59.713476775 +0000 UTC m=+2040.862522344" Jul 09 05:06:00.646815 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:00.646777 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:00.651634 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:00.651612 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:00.696922 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:00.696900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:00.697890 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:00.697873 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:09.127101 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:09.127065 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:06:16.739486 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:16.739444 2561 patch_prober.go:28] interesting pod/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 05:06:16.739868 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:16.739514 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 05:06:17.774274 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:17.774195 2561 generic.go:356] "Generic (PLEG): container finished" podID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerID="88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0" exitCode=0 Jul 09 05:06:17.774274 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:17.774256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" event={"ID":"d0099f13-0500-4738-b2bb-5daf9cfb37de","Type":"ContainerDied","Data":"88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0"} Jul 09 05:06:17.774716 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:17.774651 2561 scope.go:117] "RemoveContainer" containerID="88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0" Jul 09 05:06:17.775690 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:17.775664 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:17.775744 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:17.775729 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:17.775778 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:17.775761 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:18.784861 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:18.784181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" event={"ID":"d0099f13-0500-4738-b2bb-5daf9cfb37de","Type":"ContainerStarted","Data":"24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e"} Jul 09 05:06:19.646820 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:19.646786 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:19.647054 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:19.647033 2561 patch_prober.go:28] interesting pod/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 05:06:19.647102 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:19.647080 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 05:06:20.646926 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:20.646887 2561 patch_prober.go:28] interesting pod/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 05:06:20.647372 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:20.646943 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 05:06:21.647141 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:21.647102 2561 patch_prober.go:28] interesting pod/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 09 05:06:21.647564 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:21.647159 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 09 05:06:22.650630 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:22.650593 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:22.651090 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:22.650872 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:22.651771 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:22.651755 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:26.224781 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:26.224738 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:06:28.761257 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:28.761216 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd"] Jul 09 05:06:28.761688 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:28.761482 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" containerID="cri-o://24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e" gracePeriod=30 Jul 09 05:06:34.017611 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.017588 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:34.155624 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155599 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-credential-socket\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.155797 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155654 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-podinfo\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.155797 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155688 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-token\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.155797 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-envoy\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.155797 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155735 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-socket\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.156019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155861 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:06:34.156019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155871 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-data\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.156019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155940 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-certs\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.156019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155964 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs74j\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-kube-api-access-vs74j\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.156019 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.155982 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0099f13-0500-4738-b2bb-5daf9cfb37de-istiod-ca-cert\") pod \"d0099f13-0500-4738-b2bb-5daf9cfb37de\" (UID: \"d0099f13-0500-4738-b2bb-5daf9cfb37de\") " Jul 09 05:06:34.156310 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156038 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:06:34.156310 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156179 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:06:34.156428 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156346 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.156428 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156363 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.156428 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156376 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.156649 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156497 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0099f13-0500-4738-b2bb-5daf9cfb37de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 05:06:34.156804 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.156776 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:06:34.158063 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.158029 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 05:06:34.158173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.158102 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-kube-api-access-vs74j" (OuterVolumeSpecName: "kube-api-access-vs74j") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "kube-api-access-vs74j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:06:34.158173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.158109 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:06:34.158173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.158125 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0099f13-0500-4738-b2bb-5daf9cfb37de" (UID: "d0099f13-0500-4738-b2bb-5daf9cfb37de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:06:34.257666 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.257626 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.257666 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.257660 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.257666 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.257670 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.257666 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.257679 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0099f13-0500-4738-b2bb-5daf9cfb37de-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.257937 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.257687 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs74j\" (UniqueName: \"kubernetes.io/projected/d0099f13-0500-4738-b2bb-5daf9cfb37de-kube-api-access-vs74j\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.257937 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.257697 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0099f13-0500-4738-b2bb-5daf9cfb37de-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:06:34.869864 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.869831 2561 generic.go:356] "Generic (PLEG): container finished" podID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerID="24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e" exitCode=0 Jul 09 05:06:34.870060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.869894 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" Jul 09 05:06:34.870060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.869932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" event={"ID":"d0099f13-0500-4738-b2bb-5daf9cfb37de","Type":"ContainerDied","Data":"24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e"} Jul 09 05:06:34.870060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.870004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd" event={"ID":"d0099f13-0500-4738-b2bb-5daf9cfb37de","Type":"ContainerDied","Data":"80cc2f4aa1eee791909ccae1f11a49ffe306ec32714cb59f00ca0ae787f20569"} Jul 09 05:06:34.870060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.870054 2561 scope.go:117] "RemoveContainer" containerID="24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e" Jul 09 05:06:34.879117 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.878945 2561 scope.go:117] "RemoveContainer" containerID="88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0" Jul 09 05:06:34.886407 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.886392 2561 scope.go:117] "RemoveContainer" containerID="24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e" Jul 09 05:06:34.886630 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:06:34.886615 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e\": container with ID starting with 24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e not found: ID does not exist" containerID="24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e" Jul 09 05:06:34.886687 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.886639 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e"} err="failed to get container status \"24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e\": rpc error: code = NotFound desc = could not find container \"24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e\": container with ID starting with 24ce2af70485b8b577cea20620427607cea2e4654d453de7f180e7b14cef631e not found: ID does not exist" Jul 09 05:06:34.886687 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.886654 2561 scope.go:117] "RemoveContainer" containerID="88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0" Jul 09 05:06:34.886877 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:06:34.886856 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0\": container with ID starting with 88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0 not found: ID does not exist" containerID="88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0" Jul 09 05:06:34.886941 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.886892 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0"} err="failed to get container status \"88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0\": rpc error: code = NotFound desc = could not find container \"88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0\": container with ID starting with 88475a199d2e8ed2350b1a76627f2c46c60bbdffab7774a3f341c4bd17f8b9d0 not found: ID does not exist" Jul 09 05:06:34.893466 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.893443 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd"] Jul 09 05:06:34.898119 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:34.898098 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ad2943-openshift-default-8c85ff6cc-xmjsd"] Jul 09 05:06:35.443621 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:35.443584 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" path="/var/lib/kubelet/pods/d0099f13-0500-4738-b2bb-5daf9cfb37de/volumes" Jul 09 05:06:36.238767 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.238738 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm"] Jul 09 05:06:36.239110 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239098 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" Jul 09 05:06:36.239173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239112 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" Jul 09 05:06:36.239173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239123 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" Jul 09 05:06:36.239173 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239129 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" Jul 09 05:06:36.239281 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239227 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" Jul 09 05:06:36.239281 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239246 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c11877d-b82d-4e80-b1a8-3f12b866f7cd" containerName="istio-proxy" Jul 09 05:06:36.239281 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.239257 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" Jul 09 05:06:36.243979 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.243962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.246209 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.246193 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f932f4-openshift-default-dockercfg-4b6xq\"" Jul 09 05:06:36.253000 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.252976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm"] Jul 09 05:06:36.378902 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.378862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-certs\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379072 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.378918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istiod-ca-cert\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379072 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-data\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379072 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5mts\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-kube-api-access-k5mts\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379189 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-socket\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379189 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379100 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-credential-socket\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379189 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-token\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379189 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-envoy\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.379360 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.379194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-podinfo\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480368 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istiod-ca-cert\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-data\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5mts\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-kube-api-access-k5mts\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-socket\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-credential-socket\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-token\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-envoy\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-podinfo\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-certs\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480770 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-data\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.480852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-credential-socket\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.481386 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.480893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-certs\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.481386 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.481105 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-socket\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.481386 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.481183 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istiod-ca-cert\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.482832 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.482811 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-envoy\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.483113 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.483096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-podinfo\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.488480 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.488459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5mts\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-kube-api-access-k5mts\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.488830 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.488779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-token\") pod \"e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.556032 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.556002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:36.710552 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.710527 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm"] Jul 09 05:06:36.712461 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:06:36.712432 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707743ad_91c6_49a5_9fdc_80f7ae9de9ce.slice/crio-defd8a6f691fe27d0e50268b69b47f00059dea7b0b78f9bf650599c1b19ceb7a WatchSource:0}: Error finding container defd8a6f691fe27d0e50268b69b47f00059dea7b0b78f9bf650599c1b19ceb7a: Status 404 returned error can't find the container with id defd8a6f691fe27d0e50268b69b47f00059dea7b0b78f9bf650599c1b19ceb7a Jul 09 05:06:36.714542 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.714512 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:36.714641 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.714586 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:36.714641 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.714629 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:36.883261 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.883228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" event={"ID":"707743ad-91c6-49a5-9fdc-80f7ae9de9ce","Type":"ContainerStarted","Data":"21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305"} Jul 09 05:06:36.883444 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.883277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" event={"ID":"707743ad-91c6-49a5-9fdc-80f7ae9de9ce","Type":"ContainerStarted","Data":"defd8a6f691fe27d0e50268b69b47f00059dea7b0b78f9bf650599c1b19ceb7a"} Jul 09 05:06:36.902731 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:36.902677 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podStartSLOduration=0.902655932 podStartE2EDuration="902.655932ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 05:06:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:06:36.900912365 +0000 UTC m=+2078.049957937" watchObservedRunningTime="2026-07-09 05:06:36.902655932 +0000 UTC m=+2078.051701502" Jul 09 05:06:37.556419 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:37.556388 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:37.560829 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:37.560807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:37.888208 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:37.888179 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:37.889218 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:37.889199 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:39.233037 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:39.233003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:06:52.222837 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:52.222795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:06:53.682309 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.681608 2561 patch_prober.go:28] interesting pod/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:39158->10.132.0.40:15021: read: connection reset by peer" start-of-body= Jul 09 05:06:53.682309 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.681682 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": read tcp 10.132.0.2:39158->10.132.0.40:15021: read: connection reset by peer" Jul 09 05:06:53.968142 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.968055 2561 generic.go:356] "Generic (PLEG): container finished" podID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerID="21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305" exitCode=0 Jul 09 05:06:53.968303 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.968133 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" event={"ID":"707743ad-91c6-49a5-9fdc-80f7ae9de9ce","Type":"ContainerDied","Data":"21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305"} Jul 09 05:06:53.968567 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.968553 2561 scope.go:117] "RemoveContainer" containerID="21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305" Jul 09 05:06:53.969537 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.969513 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:53.969604 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.969576 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:53.969655 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:53.969604 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 05:06:54.974902 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:54.974869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" event={"ID":"707743ad-91c6-49a5-9fdc-80f7ae9de9ce","Type":"ContainerStarted","Data":"1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2"} Jul 09 05:06:55.557090 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:55.557050 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:55.557416 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:55.557384 2561 patch_prober.go:28] interesting pod/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 09 05:06:55.557534 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:55.557433 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 09 05:06:56.556855 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:56.556820 2561 patch_prober.go:28] interesting pod/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 09 05:06:56.557460 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:56.556882 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 09 05:06:57.556658 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:57.556623 2561 patch_prober.go:28] interesting pod/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 09 05:06:57.556837 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:57.556677 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 09 05:06:58.557221 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:58.557183 2561 patch_prober.go:28] interesting pod/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 09 05:06:58.557661 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:58.557238 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 09 05:06:59.532049 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:59.532021 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 05:06:59.537184 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:59.537162 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 05:06:59.560055 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:59.560034 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:59.560471 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:59.560387 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:06:59.560939 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:06:59.560923 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:10:00.428537 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:00.428504 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:10:02.768017 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:02.767986 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm"] Jul 09 05:10:02.768484 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:02.768231 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" containerID="cri-o://1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2" gracePeriod=30 Jul 09 05:10:08.030388 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.030332 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:10:08.072100 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072070 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-token\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072230 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072116 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-envoy\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072230 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072156 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-data\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072230 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072189 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-socket\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072230 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072226 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-certs\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072482 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072252 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istiod-ca-cert\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072482 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072363 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5mts\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-kube-api-access-k5mts\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072482 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072418 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-podinfo\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072482 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072469 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-credential-socket\") pod \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\" (UID: \"707743ad-91c6-49a5-9fdc-80f7ae9de9ce\") " Jul 09 05:10:08.072696 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072504 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:10:08.072757 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072721 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 05:10:08.072866 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072790 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-certs\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.072866 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072809 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istiod-ca-cert\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.073013 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.072978 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:10:08.073199 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.073148 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:10:08.073199 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.073157 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:10:08.074623 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.074596 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 05:10:08.074623 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.074603 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:10:08.074804 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.074789 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 05:10:08.074949 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.074932 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-kube-api-access-k5mts" (OuterVolumeSpecName: "kube-api-access-k5mts") pod "707743ad-91c6-49a5-9fdc-80f7ae9de9ce" (UID: "707743ad-91c6-49a5-9fdc-80f7ae9de9ce"). InnerVolumeSpecName "kube-api-access-k5mts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 05:10:08.173699 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173666 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-token\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.173699 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173697 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-envoy\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.173699 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173705 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-data\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.173872 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173712 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-workload-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.173872 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173721 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5mts\" (UniqueName: \"kubernetes.io/projected/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-kube-api-access-k5mts\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.173872 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173730 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-istio-podinfo\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.173872 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.173746 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/707743ad-91c6-49a5-9fdc-80f7ae9de9ce-credential-socket\") on node \"ip-10-0-142-255.ec2.internal\" DevicePath \"\"" Jul 09 05:10:08.866852 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.866814 2561 generic.go:356] "Generic (PLEG): container finished" podID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerID="1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2" exitCode=0 Jul 09 05:10:08.867045 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.866869 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" Jul 09 05:10:08.867045 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.866874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" event={"ID":"707743ad-91c6-49a5-9fdc-80f7ae9de9ce","Type":"ContainerDied","Data":"1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2"} Jul 09 05:10:08.867045 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.866946 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm" event={"ID":"707743ad-91c6-49a5-9fdc-80f7ae9de9ce","Type":"ContainerDied","Data":"defd8a6f691fe27d0e50268b69b47f00059dea7b0b78f9bf650599c1b19ceb7a"} Jul 09 05:10:08.867045 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.866975 2561 scope.go:117] "RemoveContainer" containerID="1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2" Jul 09 05:10:08.875528 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.875509 2561 scope.go:117] "RemoveContainer" containerID="21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305" Jul 09 05:10:08.883152 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.883135 2561 scope.go:117] "RemoveContainer" containerID="1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2" Jul 09 05:10:08.883409 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:10:08.883391 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2\": container with ID starting with 1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2 not found: ID does not exist" containerID="1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2" Jul 09 05:10:08.883465 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.883417 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2"} err="failed to get container status \"1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2\": rpc error: code = NotFound desc = could not find container \"1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2\": container with ID starting with 1abbbb514d918854b0cab53a6dcdc605abf2a98c8e7ee7667d63388fa2a984a2 not found: ID does not exist" Jul 09 05:10:08.883465 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.883432 2561 scope.go:117] "RemoveContainer" containerID="21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305" Jul 09 05:10:08.883635 ip-10-0-142-255 kubenswrapper[2561]: E0709 05:10:08.883617 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305\": container with ID starting with 21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305 not found: ID does not exist" containerID="21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305" Jul 09 05:10:08.883675 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.883641 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305"} err="failed to get container status \"21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305\": rpc error: code = NotFound desc = could not find container \"21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305\": container with ID starting with 21b8ec912d9bd26bd870d3813017b4907ca30b90936307996eb32ab621051305 not found: ID does not exist" Jul 09 05:10:08.887602 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.887581 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm"] Jul 09 05:10:08.890726 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:08.890706 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f932f4-openshift-default-55869ddbcf-8j6qm"] Jul 09 05:10:09.450086 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:09.450050 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" path="/var/lib/kubelet/pods/707743ad-91c6-49a5-9fdc-80f7ae9de9ce/volumes" Jul 09 05:10:12.126753 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:12.126714 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gmrt4"] Jul 09 05:10:15.103675 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:15.103649 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-5wv8t_064671e1-ea33-477b-973a-c436e7d78703/copy-manifests/0.log" Jul 09 05:10:15.110203 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:15.110183 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-5wv8t_064671e1-ea33-477b-973a-c436e7d78703/manager/0.log" Jul 09 05:10:17.301131 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:17.301097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gmrt4_b9184d1e-1ccf-4548-83bc-668ca77e34a2/limitador/0.log" Jul 09 05:10:17.750753 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:17.750722 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fkmvm_dd9baadc-a553-4acb-846a-aa47dc92e238/istio-proxy/0.log" Jul 09 05:10:17.866547 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:17.866517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bnvnp_6dca7bc7-c495-48e5-8e71-f367706d4ff2/discovery/0.log" Jul 09 05:10:18.537887 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:18.537858 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fffb79c5-wh6w7_7fe0d56a-70d3-4d82-b608-7205a506c151/router/0.log" Jul 09 05:10:19.204662 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:19.204635 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db458sx_5e442616-2da6-40d6-aebb-fbbda86e096e/main/0.log" Jul 09 05:10:25.983682 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:25.983654 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lm7kb_85d0abb1-ac9c-45ca-a4bf-548bc3b3a052/global-pull-secret-syncer/0.log" Jul 09 05:10:26.136017 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:26.135988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tzdhs_9770693f-e51a-468f-b045-d9ba60e87abe/konnectivity-agent/0.log" Jul 09 05:10:26.204849 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:26.204826 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-255.ec2.internal_acd4d634ee249d4b487dddc3a283d199/haproxy/0.log" Jul 09 05:10:32.081161 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:32.081085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gmrt4_b9184d1e-1ccf-4548-83bc-668ca77e34a2/limitador/0.log" Jul 09 05:10:34.119606 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.119583 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-rj7p6_04ef2507-0028-4bf0-b01d-c19acd7e7e81/cluster-monitoring-operator/0.log" Jul 09 05:10:34.264184 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.264156 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4tr75_ba0691a0-e276-4505-a8f9-323188eae54f/node-exporter/0.log" Jul 09 05:10:34.285074 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.285051 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4tr75_ba0691a0-e276-4505-a8f9-323188eae54f/kube-rbac-proxy/0.log" Jul 09 05:10:34.306924 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.306908 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4tr75_ba0691a0-e276-4505-a8f9-323188eae54f/init-textfile/0.log" Jul 09 05:10:34.573791 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.573711 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/prometheus/0.log" Jul 09 05:10:34.597060 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.597036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/config-reloader/0.log" Jul 09 05:10:34.629223 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.629198 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/thanos-sidecar/0.log" Jul 09 05:10:34.650641 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.650613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/kube-rbac-proxy-web/0.log" Jul 09 05:10:34.671350 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.671325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/kube-rbac-proxy/0.log" Jul 09 05:10:34.692780 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.692759 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/kube-rbac-proxy-thanos/0.log" Jul 09 05:10:34.714197 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.714167 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_550806ed-1570-4845-a6c8-de5c92a1ad11/init-config-reloader/0.log" Jul 09 05:10:34.904573 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.904542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c96fb698-xzzw5_94346f53-8038-49e9-854b-7dce290b3605/thanos-query/0.log" Jul 09 05:10:34.927999 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.927971 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c96fb698-xzzw5_94346f53-8038-49e9-854b-7dce290b3605/kube-rbac-proxy-web/0.log" Jul 09 05:10:34.950319 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.950279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c96fb698-xzzw5_94346f53-8038-49e9-854b-7dce290b3605/kube-rbac-proxy/0.log" Jul 09 05:10:34.971262 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.971241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c96fb698-xzzw5_94346f53-8038-49e9-854b-7dce290b3605/prom-label-proxy/0.log" Jul 09 05:10:34.990759 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:34.990739 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c96fb698-xzzw5_94346f53-8038-49e9-854b-7dce290b3605/kube-rbac-proxy-rules/0.log" Jul 09 05:10:35.011099 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:35.011076 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c96fb698-xzzw5_94346f53-8038-49e9-854b-7dce290b3605/kube-rbac-proxy-metrics/0.log" Jul 09 05:10:36.229489 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229457 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl"] Jul 09 05:10:36.229868 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229846 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" Jul 09 05:10:36.229868 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229858 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" Jul 09 05:10:36.229945 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229870 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" Jul 09 05:10:36.229945 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229876 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0099f13-0500-4738-b2bb-5daf9cfb37de" containerName="istio-proxy" Jul 09 05:10:36.229945 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229897 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" Jul 09 05:10:36.229945 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229902 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" Jul 09 05:10:36.230105 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.229969 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="707743ad-91c6-49a5-9fdc-80f7ae9de9ce" containerName="istio-proxy" Jul 09 05:10:36.233232 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.233214 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.235369 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.235346 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts86v\"/\"openshift-service-ca.crt\"" Jul 09 05:10:36.235491 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.235471 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts86v\"/\"kube-root-ca.crt\"" Jul 09 05:10:36.236230 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.236216 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ts86v\"/\"default-dockercfg-lmq77\"" Jul 09 05:10:36.240460 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.240440 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl"] Jul 09 05:10:36.320682 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.320646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-sys\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.320682 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.320684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-lib-modules\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.320909 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.320748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-podres\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.320909 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.320813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptz4m\" (UniqueName: \"kubernetes.io/projected/9164e450-5f42-437c-8a0c-669e03302042-kube-api-access-ptz4m\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.320909 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.320832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-proc\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.391453 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.391424 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-8tlzr_101e9068-82b9-47e9-95f3-b56cb5a33923/networking-console-plugin/0.log" Jul 09 05:10:36.421342 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-sys\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421444 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-lib-modules\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421444 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-podres\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421444 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421423 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-sys\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421602 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptz4m\" (UniqueName: \"kubernetes.io/projected/9164e450-5f42-437c-8a0c-669e03302042-kube-api-access-ptz4m\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421602 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-lib-modules\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421602 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-podres\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421602 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-proc\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.421602 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.421564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9164e450-5f42-437c-8a0c-669e03302042-proc\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.428742 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.428725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptz4m\" (UniqueName: \"kubernetes.io/projected/9164e450-5f42-437c-8a0c-669e03302042-kube-api-access-ptz4m\") pod \"perf-node-gather-daemonset-nb5fl\" (UID: \"9164e450-5f42-437c-8a0c-669e03302042\") " pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.544202 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.544117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:36.676668 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.676635 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl"] Jul 09 05:10:36.680351 ip-10-0-142-255 kubenswrapper[2561]: W0709 05:10:36.680325 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9164e450_5f42_437c_8a0c_669e03302042.slice/crio-6dfb74cc9e3ac572700d55223a920be57f8d1dae4eb44e088358c401bf496a48 WatchSource:0}: Error finding container 6dfb74cc9e3ac572700d55223a920be57f8d1dae4eb44e088358c401bf496a48: Status 404 returned error can't find the container with id 6dfb74cc9e3ac572700d55223a920be57f8d1dae4eb44e088358c401bf496a48 Jul 09 05:10:36.994252 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.994221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" event={"ID":"9164e450-5f42-437c-8a0c-669e03302042","Type":"ContainerStarted","Data":"e46b3b7655eba0134bdc4ea8fb7a896b5c21ea9423cba62c5a768108303995b9"} Jul 09 05:10:36.994492 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.994268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" event={"ID":"9164e450-5f42-437c-8a0c-669e03302042","Type":"ContainerStarted","Data":"6dfb74cc9e3ac572700d55223a920be57f8d1dae4eb44e088358c401bf496a48"} Jul 09 05:10:36.994492 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:36.994335 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:37.010746 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:37.010698 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" podStartSLOduration=1.010683654 podStartE2EDuration="1.010683654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 05:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 05:10:37.008621477 +0000 UTC m=+2318.157667039" watchObservedRunningTime="2026-07-09 05:10:37.010683654 +0000 UTC m=+2318.159729222" Jul 09 05:10:37.021881 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:37.021854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/1.log" Jul 09 05:10:37.026265 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:37.026239 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-7ct9c_36eea080-9d43-4068-a0d7-56d3c561d0d9/console-operator/2.log" Jul 09 05:10:38.096137 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:38.096109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hmksb_629f4a2b-a417-4371-8b4f-988f1dbafb2f/volume-data-source-validator/0.log" Jul 09 05:10:39.186987 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:39.186960 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qnsxd_11c5ceb4-0ceb-4004-9f3b-8538736c68fd/dns/0.log" Jul 09 05:10:39.207547 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:39.207519 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qnsxd_11c5ceb4-0ceb-4004-9f3b-8538736c68fd/kube-rbac-proxy/0.log" Jul 09 05:10:39.230395 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:39.230370 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8rg6r_6d889193-5d5b-429f-a351-ffb6fd8001fa/dns-node-resolver/0.log" Jul 09 05:10:39.875460 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:39.875432 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mckk4_08115717-84e7-414c-83ed-812ce8a9e66f/node-ca/0.log" Jul 09 05:10:40.820364 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:40.820331 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fkmvm_dd9baadc-a553-4acb-846a-aa47dc92e238/istio-proxy/0.log" Jul 09 05:10:40.918479 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:40.918443 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bnvnp_6dca7bc7-c495-48e5-8e71-f367706d4ff2/discovery/0.log" Jul 09 05:10:41.122051 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:41.122022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fffb79c5-wh6w7_7fe0d56a-70d3-4d82-b608-7205a506c151/router/0.log" Jul 09 05:10:41.807889 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:41.807858 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rj6pn_e3538224-1512-43c3-9a33-5362ddd714e3/serve-healthcheck-canary/0.log" Jul 09 05:10:42.300005 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:42.299963 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mq946_d37e4720-8db5-42fa-a34f-7eba60e6b08d/insights-operator/0.log" Jul 09 05:10:42.300528 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:42.300357 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-mq946_d37e4720-8db5-42fa-a34f-7eba60e6b08d/insights-operator/1.log" Jul 09 05:10:42.322618 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:42.322598 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcdvv_0472b5f7-5038-4ce6-a230-82390cde9cea/kube-rbac-proxy/0.log" Jul 09 05:10:42.342392 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:42.342369 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcdvv_0472b5f7-5038-4ce6-a230-82390cde9cea/exporter/0.log" Jul 09 05:10:42.365891 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:42.365868 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcdvv_0472b5f7-5038-4ce6-a230-82390cde9cea/extractor/0.log" Jul 09 05:10:43.009921 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:43.009893 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ts86v/perf-node-gather-daemonset-nb5fl" Jul 09 05:10:44.886913 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:44.886888 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-5wv8t_064671e1-ea33-477b-973a-c436e7d78703/manager/0.log" Jul 09 05:10:44.909756 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:44.909722 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94ccb68c4-5wv8t_064671e1-ea33-477b-973a-c436e7d78703/copy-manifests/0.log" Jul 09 05:10:46.492128 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:46.492102 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5895bc645c-9pcxc_9850c565-95aa-4835-9995-476d6b4dc0e2/manager/0.log" Jul 09 05:10:46.542414 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:46.542389 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fz8pf_df01b4cd-82ac-4d91-bb9c-ae8e675d2f77/openshift-lws-operator/0.log" Jul 09 05:10:46.904675 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:46.904646 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fkmvm_dd9baadc-a553-4acb-846a-aa47dc92e238/istio-proxy/0.log" Jul 09 05:10:46.999350 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:46.999322 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bnvnp_6dca7bc7-c495-48e5-8e71-f367706d4ff2/discovery/0.log" Jul 09 05:10:47.155713 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:47.155608 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fffb79c5-wh6w7_7fe0d56a-70d3-4d82-b608-7205a506c151/router/0.log" Jul 09 05:10:48.407258 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:48.407232 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4fkmvm_dd9baadc-a553-4acb-846a-aa47dc92e238/istio-proxy/0.log" Jul 09 05:10:48.498631 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:48.498607 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bnvnp_6dca7bc7-c495-48e5-8e71-f367706d4ff2/discovery/0.log" Jul 09 05:10:48.661112 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:48.661036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58fffb79c5-wh6w7_7fe0d56a-70d3-4d82-b608-7205a506c151/router/0.log" Jul 09 05:10:51.778661 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:51.778568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wsd9k_e60c6c3f-e7de-4e9e-852c-43b067909a3a/kube-storage-version-migrator-operator/1.log" Jul 09 05:10:51.779757 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:51.779734 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wsd9k_e60c6c3f-e7de-4e9e-852c-43b067909a3a/kube-storage-version-migrator-operator/0.log" Jul 09 05:10:52.936267 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:52.936237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/kube-multus-additional-cni-plugins/0.log" Jul 09 05:10:52.956258 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:52.956228 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/egress-router-binary-copy/0.log" Jul 09 05:10:52.976577 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:52.976555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/cni-plugins/0.log" Jul 09 05:10:52.998361 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:52.998339 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/bond-cni-plugin/0.log" Jul 09 05:10:53.019106 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:53.019088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/routeoverride-cni/0.log" Jul 09 05:10:53.040990 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:53.040972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/whereabouts-cni-bincopy/0.log" Jul 09 05:10:53.060604 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:53.060583 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9mmb_b0abb539-f936-432b-a76a-67e0568edf57/whereabouts-cni/0.log" Jul 09 05:10:53.248624 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:53.248555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kqsdm_c02b5c82-03a9-4181-b321-4ce92fb7f767/kube-multus/0.log" Jul 09 05:10:53.362220 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:53.362191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gtqwj_17f4d907-f511-40e2-ab69-e98dce57a67d/network-metrics-daemon/0.log" Jul 09 05:10:53.382502 ip-10-0-142-255 kubenswrapper[2561]: I0709 05:10:53.382477 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gtqwj_17f4d907-f511-40e2-ab69-e98dce57a67d/kube-rbac-proxy/0.log"